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The  research  for  this  dissertation  is  concerned  with  the  investigation  of  an  algebraic 
structure,  known  as  image  algebra,  which  is  used  for  expressing  algorithms  in  image  process- 
ing.  The  major  result  of  this  research  is  the  establishment  of  a  rigorous  and  coherent 
mathematical  foundation  of  the  subalgebra  of  the  image  algebra  involving  non-linear  image 
transformations.   In  particular,  a  classification  in  the  image  algebra  of  a  set  of  non-linear 
image  transformations  called  lattice  transforms  is  presented,  using  minimax  matrix  algebra 
as  a  tool.   Seveial  applications  to  image  processing  problems  are  discussed.   Specifically,  in 
addition  to  describing  several  non-!incar  transfoim  tlecomi)osition  technicjues,  the  subalgebra 
is  used  as  a  model  and  a  tool  for  the  development  of  methods  to  compute  lattice  transforms 
locally. 


The  basic  operands  and  operations  of  the  image  algebra  and  minimax  algebra  are 
defined,  as  well  as  the  relationships  between  the  two  algebras.   Properties  of  the  minimax 
algebra  including  the  lattice  eigenvalue  problem  are  mapped  to  the  image  algebra. 
Mathematical  morphology  is  shown  to  be  embedded  in  the  image  algebra  as  a  special  su]> 
class  of  lattice  transforms.   Networks  of  processors  are  modeled  as  graphs,  and  images  are 
represented  as  functions  defined  on  the  nodes  of  the  gra])h.   It  is  shown  that  every  lattice 
image-to-image  transform  can  be  weakly  factored  into  a  pioduct  of  lattice  transformations 
each  of  which  are  implementable  on  the  network  if  and  only  if  the  graph  corresponding  to 
the  network  is  strongly  connected.    Necc&sary  and  sufficient  conditions  are  given  to  decom- 
pose a  rectangular  template  into  two  strip  templates.   A  division  algorithm  is  given  which  is 
a  generalization  of  a  boolean  skeletonizing  technicjue.   The  transportation  problem  from 
linear  programming  is  expressed  in  the  image  algebra.   A  method  to  produce  an  image  com- 
plexity measure  is  discussed.    Most  results  are  given  both  in  image  algebra  and  matrix  alge- 
bra notation. 


INTRODUCTION 

Rackgrniind  of  the  Tm^gp  Algebra 

The  results  presented  in  this  dissertation  reflect  the  ongoing  investigation  of  the  struc- 
ture of  the  Air  Force  image  algebra,  an  algebraic  structure  specifically  designed  for  use  in 
image  processing.   The  idea  of  establishing  a  unifying  theory  for  concepts  and  operations 
encountered  in  image  and  signal  processing  has  been  pursued  for  a  number  of  years  now.    It 
was  the  1950's  work  of  von  Neumann  that  inspired  Unger  to  propose  a  "cellular  array" 
machine  on  which  to  implement,  in  parallel,  many  algorithms  for  image  processing  and 
analysis  [1,2].   Among  the  machines  embodying  the  original  automaton  envisioned  by  von 
Neumann  are  NASA's  massively  parallel  processor  or  MPP  [3],  and  the  CLIP  series  of  com- 
puters developed  by  M.J.B.  Duff  and  his  colleagues  [4,5].   A  more  general  class  of  cellular 
array  computers  are  pyramids  [6]  and  the  Connection  Machine,  by  Thinking  Machines  Cor- 
poration [7]. 

Many  of  the  operations  that  cellular  array  machines  perform  can  be  expressed  by  a  set 
of  primitives,  or  simple  elementary  operations.   One  opinion  of  researchers  who  design  paral- 
lel image  processing  architectures  is  that  a  wide  class  of  image  transformations  can  be 
represented  by  a  small  set  of  basic  operations  that  induce  these  architectures.    G.  Matheron 
and  J.  Serra  developed  a  set  of  two  primitives  that  formed  the  basis  for  the  initial  develop- 
ment of  a  theoretical  formalism  capable  of  expressing  a  large  number  of  algorithms  for  image 
processing  and  analysis.    Special  purpose  parallel  architcctuics  were  then  designed  to  imple- 
ment these  ideas.   Several  systems  in  use  today  are  Matheron  and  Scrra's  Texture 


Analyzer  [8],  the  Cytocomputer  at  tlie  Environmental  Research  Institute  of  Michigan  (EREM) 
[9,10],  and  Martin  Marietta's  GAPP  [11]. 

The  basic  mathematical  formalism  associated  with  the  above  cellular  architectures  are 
the  concepts  of  pixel  neighborhood  arithmetic  and  mathematical  morphology.   Mathematical 
morphology  is  a  mathematical  structure  used  in  image  processing  to  express  image  processing 
transformations  by  the  use  of  strucluring  elements,  which  are  related  to  the  shape  of  the 
objects  to  be  analyzed.   The  origins  of  mathematical  morphology  lie  in  work  done  by  H.  Min- 
kowski and  H.  Hadwiger  on  geometric  measure  theory  and  integral  geometry  [12,13,14].   It 
was  Matheron  and  Serra  who  used  a  few  of  Minkowski's  operations  as  a  basis  for  describing 
morphological  image  transformations  J15,1G],  and  then  implemented  their  ideas  by  building 
the  Texture  Analyzer  System.   Some  recent  research  papers  on  morphological  image  process- 
ing are  Crimmins  and  Brown  [17],  Haralick,  Lee  and  Shapiro  [18],  Haralick,  Sternberg  and 
Zhuang  [19],  and  Maragos  and  Schafer  [20,21,22]. 

It  was  Serra  and  Sternberg  who  first  unified  morphological  concepts  into  an  algebraic 
theory  specifically  focusing  on  image  processing  and  image  analysis.   The  first  to  use  the  term 
'Image  Algebra"  was,  in  fact,  Sternberg  [23,24].   Recently,  a  new  theory  encompassing  a 
large  class  of  linear  and  nonlinear  systems  was  put  forth  by  P.  Maragos  [25].   However, 
despite  these  profound  accomplishments,  morphological  methods  have  some  well  known  limi- 
tations.  They  cannot,  with  the  exception  of  a  few  simple  cases,  express  some  fairly  common 
image  processing  technicjues  such  as  Fourier-like  transformations,  feature  extraction  based  on 
convolution,  histogram  ecjualization  transforms,  chain-coding,  and  image  rotation.    At 
Perkin-Elmer,  P.  Miller  demonstrated  that  a  straightforward  and  uncomplicated  target 
detection  algorithm,  furnished  by  the  U.S.  Government,  could  not  be  expressed  using  a  mor- 
phologically based  image  algebra  [26|. 


The  morphological  image  algebra  is  built  on  the  Minkowski  addition  and  subtraction  of 
sets  [14],  and  it  is  this  set-theoretic  formulation  of  its  basic  operations  which  does  not  enable 
mathematical  morphology  to  be  used  as  a  basis  for  a  general  purpose  algebraic  based 
language  for  digital  image  processing.   These  operations  ignore  the  linear  domain,  transfor- 
mations between  different  domains  (spaces  of  different  dimensionalities)  and  transformations 
between  different  value  sets,  e.g.  sets  consisting  of  real,  complex,  or  vector  valued  numbers. 
The  image  algebra  which  was  developed  at  the  University  of  Florida  includes  these  concepts 
and  also  incorporates  and  extends  the  morphological  operations. 

Parallel  Image  Processing 

The  processing  of  images  on  digital  computers  recjuires  enormous  amounts  of  time  and 
memory.   With  the  advent  of  Very  Large  Scale  Integrated  (VLSI)  circuits,  the  cellular  array 
of  von  Neumann  became  a  reality.   There  are  many  types  of  parallel  architectures  in 
existence  [27],  and  various  ways  of  categorizing  them  have  been  attempted  [28].    The  general 
scheme  of  one  popular  type  of  parallel  processor  is  to  have  many  processing  elements,  or 
small  processors  with  limited  memory,  interconnected  by  communication  links.   Each  pro- 
cessing element  can  communicate  directly  with  a  single  controller  as  well  as  with  a  very 
small  number  of  its  neighbors,  usually  1  to  8.   When  the  controller  gives  a  signal,  all  process- 
ing elements  simultaneously  perform  some  arithmetic  and/or  logic  operation  using  the  values 
of  its  neighbors  to  which  it  is  connected.   This  tyj^e  of  parallel  processor  is  called  a  neighbor- 
hood array  processor,  as  communication  links  connect  the  center  processor  to  a  small  subset 
of  its  spatially  nearest  neighbors.   Two  typical  neighborhood  configurations  for  local  inter- 
connection links  are  given  below.   The  box  with  the  x  represents  the  center  processor,  and 
the  four  (or  eight)  boxes  immediately  adjacent  to  x  represent  the  four  (or  eight)  processors 


with  whom  x  can  send  and  receive  information  via  the  communication  links.   The  set  of  pixel 
locations  relative  to  the  center  pixel  location,  x,  form  the  local  neighborhood  of  x. 


X 

X 

\     / 

(a)  (b) 

Figure  1.  Two  Neighborhood  Configurations. 

(a)  The  von  Neumann  Configuration;  (b)  The  Moore  Configuration. 


Some  of  the  parallel  processors  that  have  been  built  to  implement  this  type  of  connection 
scheme  are  the  MPP,  the  Distributed  Array  Processor  (ICL  DAP)  [27,29],  the  Geometric 
Arithmetic  Parallel  Processor  (GAPP),  and  the  CLIP4.  There  are  other  types  of  parallel 
architectures,  such  as  pipeline  computers  [23]  and  systolic  arrays  [30],  which  differ  in  con- 
struction and  implementation  of  the  neighborhood  functions.  However,  the  key  feature  in 
most  of  these  architectures  is  that  they  have  a  large  number  of  processing  elements,  each  of 
which  communicates  directly  with  only  a  small  subset  of  the  others. 

If  every  value  of  a  transformed  image  at  location  x  involves  arithmetically  or  logically 
manipulating  information  only  from  pixel  locations  in  the  local  neighborhood  of  x,  then  the 
transform  is  called  a  local  transform.  Assuming  that  a  transform  can  be  described  in  a  local 
manner,  the  amount  of  time  to  })erform  a  local  operation  globally  on  neighborhood  array  pro- 
cessors is  the  amount  of  time  it  takes  one  processor  to  perform  it,  often  a  single  clock  cycle. 
Certain  image  transforms  which  were  previously  too  computationally  intensive  can  now  be 
implemented  on  parallel  and  distributed  processors. 


In  general,  image  transforms  are  not  local,  that  is,  the  calculation  of  a  transformed 
value  may  depend  on  input  values  which  are  spatially  very  distant  from  the  processing  ele- 
ment.  In  order  to  use  parallel  processors,  the  transform  must  first  be  decomposed  into  a  pro- 
duct of  local  transforms.   The  existence  of  local  decompositions  is  of  theoretical  and  practical 
interest,  and  as  such  provides  the  main  thrust  behind  the  research  in  this  dissertation. 

While  such  parallel  architectures  are  attractive  for  use  in  image  processing,  much 
research  still  needs  to  be  done  and  implementation  techniques  developed  in  order  to  use  the 
architectures  most  efficiently. 

Summary  of  Results 
The  results  in  this  dissertation  stem  from  an  investigation  into  the  image  algebra  opera- 
tions of  M  ,  ©,  and  V.   A  brief  description  of  the  image  algebra  and  its  use  as  a  model  for 
image  processing  is  presented.   A  full  discussion  of  the  entire  image  algebra  is  presented  by 
Ritter  et  al.  [31].   The  results  given  here  focus  mainly  on  two  non-linear  image  transform 
operations  whose  underlying  values  have  the  structure  of  a  lattice.   In  particular,  it  is  shown 
that  a  previously  determined,  well-defined  mathematical  structure  called  the  minimax  alge- 
bra can  be  used  to  place  the  study  of  a  wide  class  of  non-linear,  lattice-based  image 
transforms  on  a  solid  mathematical  foundation.   We  also  discuss  the  mapping  of  these 
transforms  to  certain  types  of  parallel  architectures. 

It  has  been  well  established  that  the  image  algebra  is  capable  of  expressing  all  linear 
transformations  [32].   The  embedding  of  linear  algebra  into  the  image  algebra  makes  this 
possible.   The  major  contributions  of  this  thesis  are  the  development  of  two  isomorphisms 
between  the  minimax  algebra  and  image  algebra  which  refines  the  lattice  subalgebra  of  the 
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image  algebra,  and  the  development  of  new  and  useful  mathematical  tools  which  are  of  prac- 
tical use  in  the  area  of  image  processing. 

The  dissertation  is  divided  into  two  parts.   Part  I  gives  an  introduction  to  the  two  alge- 
bras, the  image  algebra  and  minimax  algebra.   Part  II  is  devoted  to  presenting  new  matrix 
theoretical  results  which  have  applications  to  solving  image  processing  problems. 
Specifically,  Chapter  1  is  of  an  introductory  nature,  presenting  a  historical  background  of  the 
image  algebra  and  a  brief  discussion  of  where  lattice  structures  appear  to  be  useful  in 
mathematically  characterizing  problems  in  image  processing  and  operations  research. 
Chapter  1  also  presents  a  brief  introduction  to  the  image  algebra  as  well  as  to  the  minimax 
algebra.    We  mention  that  although  vector  lattices  are  contained  within  the  image  algebra, 
they  have  been  investigated  [33]  and  will  not  be  discussed  here.   The  isomorphisms  which 
embed  the  minimax  algebra  into  the  image  algebra  are  given  in  Chapter  2,  and  mapping  of 
the  minimax  algebra  properties  in  image  algebra  notation  are  presented  in  Chapter  3.   In 
Chapter  4  we  give  the  relationship  of  mathematical  morphology  to  image  algebra.   In 
Chapter  5  we  present  new  matrix  theoretical  results,  which  have  applications  to  template 
decomposition.   An  algorithm  similar  to  the  division  algorithm  for  integers  is  given  both  in 
minimax  algebra  and  image  algebra  notation  in  Chapter  6.   In  Chapter  7  we  present  the  for- 
mulation of  an  operations  research  in  image  algebra  notation,  and  give  an  image  complexity 
algorithm.   We  then  present  the  conclusions  and  give  suggestions  for  future  research  after 
Chapter  7, 


PART  I 
LATTICE  STRUCTURES  IN  IM4GE  ALGEBRA  AND  OPERATIONS  RESEARCH 

The  algebraic  structures  of  early  image  processing  languages  such  as  mathematical 
morphology  had  no  obvious  connection  with  a  lattice  structure.   Those  algebras  were 
developed  to  express  binary  image  manipulation.   As  the  extension  to  gray  valued  images 
developed,  the  notions  of  performing  maximums  and  minimums  over  a  set  of  numbers 
emerged.   Formal  links  to  lattice  structures  were  not  developed  until  very  recently  [34], 
including  this  dissertation.   We  present  a  little  background  in  this  area,  showing  how  the  lat- 
tice properties  were  inherent  in  the  structures  being  developed. 

The  algebraic  operations  developed  by  Serra  and  Sternberg  are  equivalent  and  based  on 
the  operations  of  Minkowski  addition  and  Minkowski  subtraction  of  sets  in  R".   Given  A 
C  R"  and  B  C  R",  Minkowski  addition  is  defined  by 

A+B   =  {a  +  b:a6A,  bGB} 
and  Minkowski  subtraction  is  defined  by 


A/B   -  A  +B , 

where  the  bar  denotes  set  complementation.   Mathematical  morphology  was  initially 
developed  for  boolean  image  processing,  that  is,  for  processing  images  that  have  only  two 
values,  say  0  and  L   It  was  eventually  extended  to  include  gray-level  image  processing,  that 
is,  images  that  take  on  more  than  two  values.    The  value  set  underlying  the  gray  value 
mathematical  morphology  structure  was  the  set  R_oc,  =  R  U  {— oo  },  the  real  numbers  with 
—  oo  adjoined.    Sternberg's  functional  notation  is  most  often  used  to  express  the  two  morpho- 
logical operations,  as  it  is  simply  stated  and  easy  to  implement  in  computer  code.   The  gray 
value  operations  of  dilation  and  erosion,  corresponding  to  Minkowski  addition  and 
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subtraction,  respectively,  are 

D(x,y)   -  max  [  A(x  -  i,  y  -  i)  +  B(i,j)  ] 
>.j 

E(x,y)   =  mill  [A(x  -  i,y  -  i)  -  B(-i,-j)] 

respectively,  where  A  and  B  are  real  valued  functions  on  R". 

As  will  be  shown,  mathematical  morphology,  which  uses  the  lattice  R_oo,  is  actually  a 
very  special  subalgebra  of  the  full  image  algebra.   It  is  well  known  that 
R_^(„  =  R  U  {+00,  —oc  }  is  a  complete  lattice  [35].   The  lattice  structure  provides  the  basis 
for  categorizing  certain  classes  of  image  processing  problems,  which  is  the  main  subject  of 
this  dissertation. 

Operations  research  has  long  been  known  for  its  class  of  problems  in  optimization.   A 
certain  type  of  non-linear  operations  research  problems  has  been  the  focus  of  Cuninghame- 
Green  during  his  research  [36,37].   The  types  of  optimization  problems  that  were  considered 
by  this  author  used  arithmetic  operations  different  from  the  usual  multiplication  and  summa- 
tion.  Some  machine  scheduling  and  shortest  path  problems,  for  example,  could  be  best 
characterized  by  a  non-linear  system  utilizing  additions  and  maximums.   A  monograph  enti- 
tled Minimax  Algebra  [38]  describes  a  matrix  calculus  which  uses  a  special  case  of  what  is 
called  a  generalized  matrix  product  J39],  where  matrices  and  vectors  assume  values  from  a 
lattice.   A  few  more  conditions  such  as  a  group  operation  on  the  lattice,  and  the  self-duality 
of  the  resulting  structure,  allow  Cuninghame-Grcen  to  develop  a  solid  mathematical  founda- 
tion in  which  to  pose  a  wide  variety  of  operations  research  ciuestions.   It  is  an  interesting  and 
natural  link  between  matrices  with  values  in  a  lattice  and  templates  in  the  image  algebra 
which  provides  the  foundation  of  this  dissertation. 


CHAPTER  1 
THE  TWO  ALGEBRAS 


1.1.    Tmngp  Algehra:    Rasio  Pffinitions  anrl  Notation 

.  This  section  provides  the  basic  definitions  and  notation  that  will  be  used  for  the  image 
algebra  throughout  the  dissertation.   We  will  define  only  those  image  algebra  concepts  neces- 
sary to  describe  ideas  in  this  document.   For  a  full  discourse  on  all  image  algebra  operands 
and  operations,  we  refer  the  reader  to  a  recent  publication  [31]. 

The  image  algebra  is  a  heterogeneous  algebra,  in  the  sense  of  Birkhoff  [40],  and  is  capa- 
ble of  describing  image  manipulations  involving  not  only  single  valued  images,  but  mul- 
tivalued images.   In  fact,  it  has  been  formally  proven  that  the  set  of  operations  is  sufficient 
for  expressing  any  image-to-image  transformation  defined  in  terms  of  a  finite  algorithmic  pro- 
cedure, and  also  that  the  set  of  operations  is  sufficient  for  expressing  any  image-to-image 
transformation  for  an  image  which  has  a  finite  number  of  gray  values  [41,42].   We  limit  our 
discussion  to  single  valued  images  in  this  document,  and  refer  the  reader  to  other  publica- 
tions on  multi-valued  images  [31]. 

We  will  present  the  six  basic  operands,  some  of  the  finitary  operations  defined  between 
the  operands,  and  also  give  a  few  examples. 

1.1.1.    The  Operands  of  the  Image  Algebra 

The  six  basic  operands  are  coordinate  sets,  elements  of  coordinate  sets,  value  sets,  ele- 
ments of  value  sets,  images,  and  generalized  templates.   They  are  defined  as  follows. 
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1.       A  coordinate  set  X  is  a  subset  of  R    for  some  k.   Two  familiar  coordinate  sets,  the 
rectangular  and  toroidal  coordinate  sets,  are  sliown  in  Figure  2. 


4    - 
3  -■ 


(1,4)  (2^4)  (3,4) 

(1,3)  (2^)  (3,3) 

(1.2)  (2^)  (3^) 

(U)  (24)  (3^1) 


1 


(a) 


(b) 


Figure  2.  Two  Coordinate  Sets. 

(a)  Toroidal  Lattice  X  C  R^;  (b)  A  Finite  Rectangular  Array  in  R' 


A  value  set  F  is  a  semi-group.   Some  value  .sets  we  are  interested  in  are  the  real 
numbers,  the  rational  numbers,  integers,  positive  reals,  positive  rationals,  and  positive 
integers.   These  are  denoted  by  R,  Q,  Z,  R"*",  Q"*",  and  Z"*",  respectively.   We  will  also 
be  strongly  interested  in  some  of  the  extended  number  systems.   If 
F  G  {R,Q,Z,R+,Q+},  then  F_^  denotes  F  U  { -co),  F+^  denotes  F  U  {  +  oo},  and 
Fj.oQ  denotes  F  U  {  — oo,  +oo}.   We  denote  an  arbitrary  value  set  by  F. 

An  F  valued  image  a  on  a  coordinate  set  X  is  an  element  of  F   .   Thus,  an  image 
a  G  F"   is  of  form 


a  =  {(x,a(x)):xGX,  a(x)  G  F  }. 
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4.        Let  X  and  Y  be  coordinate  sets.   An  F- valued  template  t  fro7n  Y  io  X  is  an  element 
of  (F   )^ .   For  each  y  G  Y,  t(y)  is  an  image  on  X.   Denoting  t(y)  by  ty,  we  have 

ty  =  {  (x,ty(x))  :  X  G  X,  tj,(x)  G  F  }      for  all  y  G  Y. 

We  give  a  pictorial  representation  of  a  generalized  template  t  G  (F-'^)^  in  Figure  3. 
They  are  discussed  in  detailed  in  the  section  below  on  generalized  templates. 


weights  ty(x) 


Target  Array  Y  Source  Array  X 

Figure  3.   A  Pictorial  Representation  of  a  Generalized  Template. 


The  set  X  is  called  the  set  of  image  coordinates  of  a  G  F^,  and  the  range  of  the  func- 
tion a  is  called  the  image  values  of  a.   Thus,  the  image  values  are  a  subset  of  F.   The  pair 
(x,a(x))  is  called  a  picture  element,  or  pixel,  and  x  is  the  pixel  location  of  the  pixel  value  or 
gray  value  a(x).   We  shall  use  bold  lower  case  letters,  x,  to  represent  a  vector  in  R",  and 
lower  case  letters  (not  bold)  for  the  components  of  the  vector.   Thus  x  =  ( Xj ,  .  .  .  ,  x,, )  G  R", 
where  Xj  G  R  for  all  i.   The  set  of  all  F  valued  images  on  X  is  denoted  by  Y^,  and  the  set  of 
all  F  valued  templates  from  Y  to  X  is  denoted  by  (F*^)^'. 

As  we  will  not  be  using  any  of  the  operations  concerning  coordinate  sets  or  value  sets, 
we  refer  the  reader  to  other  publications  discussing  this  topic  [31]. 
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1.1.2 Operations  on  Tmngps 

The  basic  operations  on  and  between  F  valued  images  are  the  ones  induced  by  the  alge- 
braic structure  of  the  value  set  F.  The  remaining  operations  can  be  defined  in  terms  of  these 
basic  ones.   In  particular,  if  F  =  R,  then  the  basic  operations  for  a,  b  G  R"   are 

a  +  b  =  {  (x,c(x))  :  c(x)  =  a(x)  +  b(x),  x  G  X} 

a  *  b  =  {  (x,c(x))  :  c(x)  =  a(x)  •  b(x),  x  G  X} 

a  V  b  =  {  (x,c(x))  :  c(x)  =  a(x)  V  b(x),  x  G  X} . 

If  X  is  finite,  then  we  define  the  dot  product  of  two  images  a,  b  G  R     by 

a  •  b    =    Z)  a(x)  •  b(x) . 
x6X 

We  say  an  image  a  G  F     is  a  constant  image  if  its  gray  value  at  every  pixel  location  is 
the  same.   Thus,  a  constant  image  a  G  F     has  form 

a(x)   =  k  GF,  for  all  x  GX. 
In  this  case  we  write  k  for  the  image  a.   There  are  two  constant  images  of  importance  in  the 
image  algebra.   One  is  the  zero  image,  defined  by  0  =  {(x,0))  :  x  G  X},  and  the  unit  image, 
defined  by  1  =  {(x,0))  :  x  G  X}.   These  images  have  the  following  properties. 

a+O   =  0+a   =  a 

a  *  1    =  I  *  a   =  a 

Suppose  f:  F  — +•  F  is  given.   Then  f  induces  a  function  from  F    to  F   ,  also  called  f, 

where 

f(a)    =   {(x,(b(x)):b(x)=f(a(x))}. 
For  example,  the  function  f:R\{0}  —*■  R\{0}  where  f(r)  =  r~^  induces  a  function  f: 

F^  —*■  F"^,  where  f(a)  =  b,  and  b(x)  =  J/a(x),  if  a(x)  /  0,  otherwise  b(x)  =  0.   The  image  b 

so  described  is  denoted  by  a~'.  It  is  obvious  that  a  *  a~'  7^  1  for  every  a.   But  it  is  true  that 

a  *  a~'  *  a  =  a.   For  this  reason  a,"   is  called  the  pscudo  inverse  of  a. 
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If  the  value  set  F  =  R±oo,  then  the  additive  dual  of  a  G  R^oo  is  denoted  by  a    and 


defined  by 


a(x)    = 


— a(x)      if  a(x)  G  R 
—QO       if  a(x)  =  +00 
+  00       if  a(x)  =  —00 


Thus  we  have  ( a  )   =  a. 

If  F  =  R^o^  then  the  multiplicative  dual  of  a  G  (R^^^)^  is  denoted  by  a  and  defined  by 


alx)    =    1 


l/a(x)      if  a(x)  G  R+ 
—  00        if  a(x)  =  -1-00 
+00        if  a(x)  =  —00 


It  follows  that  (a)  =  a. 

Another  useful  induced  function  is  the  characteristic  function.   Let  Xt  denote  the  usual 
characteristic  function  with  respect  to  an  arbitrary  set  T.  Here 

I   1       ifxGT 
^r^'')   "   \  0      if  X  §^  T      • 

We  now  define  the  generalized  characteristic  function  of  an  image  a  G  R^.   Let  a  G  R^  and 

S  G  (2    )   .   Then  the  generalized  characteristic  function  of  an  image  a  is  defined  as 


Xs(a)   =  c  G  R' 


where 


1      if  a(x)  G  S(x) 
{  (X,  c(x))  :  c(x)  =  ^    0      otherwise  ^ 

Note  that  the  usual  characteristic  function  above  is  a  special  case  of  the  generalized  charac- 
teristic function,  where  T  C  F  and  S(x)  =  T  for  all  x  G  X.   The  typical  thresholding  func- 
tion applied  to  an  image  is  a  simple  example  of  the  generalized  characteristic  function.   Fix 
b  G  R^.  Then  S<bG(2^)^  is  defined  by 
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S<^(x)  =  {rER:r<b(x)}. 
To  simplify  notation,  we  define  x<b  —   Xs    ■   Thus,  for  b ,  a  G  F"^,  we  have 

f    1      ifa(x)<b(x) 
X<b(a)   =   {  (x,  c(x))  :  c(x)  =  |  ^      otherwise         >■ 

If  we  now  consider  the  characteristic  function  on  R^,  we  find  that  we  would  like  our 
binary  output  image  to  have  the  values  —  oo  and  0  instead  of  O's  and  I's,  respectively.   We 
define  the  extended  characteristic  function  as  the  function  induced  by 

/    0         if  X  G  S 
■^  ^  '  y  —oo      otherwise 

Thus,  X^Ca)  is  defined  as 

^1    0         ifa(x)<b(x) 
A<b\^)       y  _oo      otherwise 

One  unary  operation  on  images  is  the  sum  operation,  which  we  will  use  in  Chapter  7.   Let  X 
be  a  finite  coordinate  set.   Then  the  sum  of  a  G  R"^  is  defined  to  be 

Zja   =  a»l   =    Zj  a(x). 
xex 

In  context  of  the  lattice  structures  of  R.^^^  and  R^^^,  we  make  the  following  definition. 

Let  a  G  R^^o-   The  maximum  of  a  is  the  scalar  determined  by 

Va   =     V  a(x). 
xex 

1.1.3.    Cenernlized  Templates 

For  a  generalized  template  t  G  (F^)^ ,  the  coordinate  set  Y  is  called  the  target 
domain  or  the  domain  of  t,  and  X  is  called  the  range  apace  of  t.   The  pixel  location  y  G  Y 
at  which  a  template  t    is  evaluated  is  called  a  target  point  of  the  template  t,  and  the  values 
ty(x)  are  called  the  weights  of  the  template  t  at  y. 
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If  F  G  {R,  R^^,  C  },  then  for  t  G  (F^')"^',  the  set 

%)   -   {xGX:yx)^0} 
is  called  the  support  ofty.   If  F  G  {R^^^,  R^^},  then  for  t  G  (F^)"^'  we  define 

5_oo(ty)   =   {xGX:yx)?^-oc} 
and 

5+oc(ty)   =   {xGX:yx)#+^} 
to  be  the  (negative)  and  positive  infinite  support,  respectively. 

If  t  G  (F    )^  and  for  all  triples  x  ,  y ,  z  G  X  with  y  +  z  and  x  +  z  G  X,  we  have 
ty(x)  =ty^^(x  +  z),  then  t  is  called  translation  invariant.   A  template  which  is  not  transla- 
tion invariant  is  called  translation  variant,  or  simply  variant.   Translation  invariant  tem- 
plates have  the  nice  property  that  they  may  be  represented  pictorially  in  a  concise  manner. 
The  following  translation  invariant  template  is  presented  pictorially  in  Figure  4.   Let 
X  =  Y  =  Z-,  and  let  y  =  (i,j)  G  Z~.   Let  Xj  =  (ij),  x.,  =  (i+l,j),  X3  =  (ij-1),  and  X4  = 

I     J       if  X  =  Xi ,  i  =  1,...,4 
0      otherwise  '   '^^^" 

%)  =  {  Xi ,  .  .  .  ,  X4  }. 


J 
J-1 


1 

2 

3 

4 

i       i+1 
Figure  4.   Example  of  a  Translation  Invariant  Template. 
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The  cell  with  the  hash  marks  iii  the  pictorial  representation  of  t  indicates  the  location  of  the 
target  point  y. 

There  are  several  representations  of  a  template  that  we  will  be  concerned  with.   One  is 
the  transpose  of  a  template.   Let  t  G  (F    )    .   Then  the  transpose  of  t  is  a  template 
t'e{F^')^  defined  by  t'^(y)  =  ty(x).    If  F  G  {R^^,  R^^},  then  we  can  introduce  a  dual 
template.   For  t  G  (Ri^)^,  the  additive  dual  of  t  is  the  template  t    G  (R^oo)'^  defined  by 


t;(y) 


-ty(x)      if  tj.(x)  G  R 
—  oo        if  tj(x)  =  +00. 
+0^       if  tj,(x)  =  -00 


Similarly,  if  t  G  ((R^^^)   )    ,  the  multiplicative  dual  of  t  is  the  template 


tG((R^ 


+  ^Y^x 


defined  by 


tx(y)  = 


l/ty(x)      if  ty(x)  G  R+ 
—  00        if  tj.(x)  =  +00. 
+  ^       ifyx)=-oo 


1.1.4.    Operations  Retween  Tmages  and  Templates 

One  common  use  of  templates  is  to  describe  some  transformation  of  an  input  image 
based  on  its  image  values  within  a  subset  of  the  coordinate  set  X.   We  first  introduce  the 
generalized  product  between  an  image  and  a  template.   Let  X  C  R"  be  finite, 
X  =  {xj,  .  .  .  ,x„^}.   Let  T  be  an  associative  binary  operation  on  the  value  set  F.   Then  the 
global  reduce  operation  T  on  F     induced  by  7  is  defined  by 


r(a)  =    r  a(x)  =a(xi)7a(x.,)7  •  ■  •  7a(xJ, 
.\fcX 


where  aGF^'.   Thus,  L-.F- 
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Images  and  templates  are  combined  by  combining  appropriate  binary  operations.   Let 
Fj,  Fo,  and  F  be  three  value  sets,  and  suppose  o:FjX  Fo  — >■  F  and  o  :  F2X  Fj  — ►  F  are 
binary  operations.   If  7  is  an  associative  binary  operation  on  F  ,  aGFj  ,  and  tG(F2  )   ,  then 
the  generalized  backward  template  operation  of  a  ivith  t  {induced  by  -)  and  o)  is  the  binary 
operation  @  :Fj^X  (Fo^)'^'  -♦•  F"^'  defined  by 

a®  t  =  {(y,b(y)):  b(y)  =  ^r_a(x)oyx),  y  £  Y}. 

If  t€(F^)^,  then  the  generalized  forward  template  operation  of  a  with  t  is  defined  as 

t  @  a  =  {(y,b(y)):  b(y)  =    T  t,(y)oa(x),  y  G  Y}. 

xfcX 

Note  that  the  input  image  a  is  an  Fj  valued  image  on  the  coordinate  set  X,  and  the 
output  image  b  is  an  F  valued  image  on  the  coordinate  set  Y,  regardless  of  which  template 
operation,  forward  or  backward,  is  used.   Templates  can  therefore  be  used  to  transform  an 
image  on  one  coordinate  set  and  with  values  in  one  set  to  an  image  on  a  completely  different 
coordinate  set  whose  values  may  be  entirely  different  from  the  original  image's. 

Only  three  special  cases  of  the  above  generalized  operation  have  been  investigated  in 
detail,  one  by  Gader  [32]  and  the  other  two  in  this  dissertation.   Future  research  will  cer- 
tainly discover  other  useful  combinations.   These  three  operations  are  denoted  by  ®,  M  ,  and 
® .   The  operation  @  is  a  linear  one,  and  we  refer  the  interested  reader  to  other  references 
for  recent  research  in  this  area  [32,43,44].   The  other  two  operations,  M  and  ® ,  are  non- 
linear, and  investigation  of  the  structure  they  induce  on  images  and  templates  is  the  focus  of 
this  dissertation. 

Since  our  main  interest  concerns  the  operations  M  and  ®,  we  will  omit  the  definition 
©  and  refer  the  interested  reader  to  another  reference  [31].   Let  X  C  R"  be  finite  and  Y 
C  R'".   Let  a  €  R^oo  ^-nd  t  G  (RZ^o^,)^  .   Then  the  backward  additive  max  is  defined  as 


18 


aiat  =  {(y,b(y)):  b(y)  =  V  a(x) +t^.(x),  y  G  Y}, 

x€X 

where   V  a(x)+tj,(x)  =  max{  a(x)+ty(x)  :  x  E  X  }. 

For  t  E  (R^oq)    we  define  the  forward  additive  max  transform  by 

tMa  =  {(y,b(y)):  b(y)  =  V  a(x)+yy),  y  €  Y}. 
xtX 

We  use  the  usual  extended  arithmetic  addition  v-\ — oo  =  — oo+r  =  —co\f  rGR.Q^  to 

define  a(x)+ty(x)  everywhere. 

For  a  €  Rl^  and  t  G  ((Rj^'o^)^)^  we  define  the  backward  multiplicative  max 
transform 

a® t  =  {(y,b(y)) :  b(y)  -  V^a(x)-t^(x),  y  G  Y} . 
The  forward  multiplicative  max  transform  is  given  by 

t®a  =  {(y,b(y)) :  b(y)  =  V  a(x)t,(y),  y  G  Y}, 
xfcX 

where  tG((R+^)"^>'^. 

Recall  that  a  lattice-ordered  group,  or  1-group,  is  a  group  which  is  also  a  lattice.  The 
operation  addition  (multiplication)  on  the  1-group  R  (R"*")  can  be  extended  in  a  well-defined 
manner  to  addition  (multiplication)  on  R^^  (R^oo)  '^y  defining 

X  X  —00  =  —CO  X  X  =  ~oo,  X  G  G  U  {  —  00} 

X  X  -1-00  = -hoc  X  X  =-f-oo,  X  G  G  U  {-foe} 

—  OCX  +00  =  +00X  —00  =  — 00 

where  X  G  {  +  ,  *  },  depending  on  whether  G  =  R  or  R"*",  respectively.   Of  course,  the  ele- 
ments +  0C,  —00  have  no  additive  inverse  under  the  operation  +  or  *,  and  hence  R^^  (or 
R^;„)  is  no  longer  a  group.   This  is  discussed  in  detail  in  section  1.2,  where  the  notion  of  a 
bounded  lattice  ordered  group,  an  extension  of  a  lattice-ordered  group  with  extended 
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arithmetic,  is  introduced.   Tiiis  provides  for  tlie  value  set  R^^  to  be  used  in  the  definition  of 
the  image-template  operation  M  ,  for  example,  and  the  value  set  R^^o  ^'^  be  used  in  the 
definition  of  the  image-template  operation  ® . 

We  remark  that  for  computational  as  well  as  theoretical  purposes,  we  can  restate  the 
above  two  convolutions  with  the  new  pixel  value  calculated  only  over  the  support  of  the  tem- 
plate t.   If  S_^(t  )  ^0,  then    V  a(x)-ft  (x)  =       V      a(x)+t  (x),  and  we  have 
x6X  '  x6S_eJty) 

a  M  t  =  {(y,b(y)  :  b(y)  =       V  ^    a(x)  +t,(x),  y  G  Y}  . 

Similarly,  if  S_^(t) /0,  then    Va(x)*t(x)=       V      a(x)*t  (x),  and 

x€X  xes_^ty) 

a  ©  t  =  { (y ,b(y)  :  b(y)  =       V      a(x)  *  t^(x),  y  G  Y  } . 

If  in  either  case  S_^{ty)  =  0,  then  we  define 

V      a(x) -t-t,.(x)      or  V      a(x)*t,,(x)      =  -oo    . 

We  may  therefore  restrict  our  computation  of  the  new  pixel  value  to  the  infinite  support  of 
ty.   This  becomes  particularly  important  when  considering  mapping  of  transforms  to  certain 
types  of  parallel  architectures,  as  will  be  discussed  in  the  introductory  remarks  to  Part  II, 
and  Chapter  5. 

Because  of  the  duality  inherent  in  the  two  structures  R^<^  and  R^^  the  operations  M 
and  ®  induce  dual  image-template  operations,  called  addilive  minimum  and  multiplicative 
minimum,  respectively.   They  are  defined  by 

a  Q  t  =  (t*  M  a*  )* 
and 

a  ®  t  =  (t  ®  a) . 
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Equivalently,  we  have 

a  Eg  t  =  {(y,b(y)):  b(y)  =  A  a(x)4-'t,(x),  y  G  Y} 


=  {(y,b(y)  :  b(y)  :^       A      a(x) +'t,(x).  y  G  Y } 


and 


t  ®  a  =  {(y,b(y)):  b(y)  =   A  a(x)*'t,(y),  y  G  Y} 
xtX 

=        A,    a(x)*'yy),yGY}. 

where  the  dual  operations  +'  and  *'  are  presented  in  section  1.2.   As  before,  if  S_^oo(t  )  =  0, 
we  define 

A      a(x)  +'t,(y)      or  A      a(x) *'t,(y)      =   +oo . 

The  above  definitions  assume  that  the  support  S_oo(t  )  is  finite  for  each  y  G  Y.   We 
may  extend  the  above  definitions  to  continuous  functions  a  and  t    on  a  compact  set  S_^{t  ) 
This  is  well-defined  as  the  sum  or  product  of  two  continuous  functions  on  a  compact  subset 
of  R",  which  is  continuous,  always  contains  a  maximum.   Extending  the  basic  properties  of 
the  image  algebra  operations  involving  M  and  ®  from  the  discrete  case  to  the  continuous 
case  should  present  little  difficulty,  and  remains  an  open  problem  at  this  time. 

1.1.5.    Operations  Between  Cenernliyed  Templnfes 

The  pointwise  operations  of  the  value  set  F  can  also  be  extended  to  to  operations 
between  templates.   For  example,  if  F  =  R,  then  we  have 

s  +  t    =   r ,  where  r^.  =  s^,  +  t 

s  *  t   =   r  ,  where  r^.  =  s    *  t 

8  V  t    =   r ,  where  r    =  s^.  V  t    . 
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s  +  t    =   r ,  where  r  (x)  = 


s,(x)+t,(x)  [ixes_jt^)ns_js^) 

s^,(x)  ifxG5_(Sy)\5_(ty) 

yx)  ifxG5_(ty)\S_(ty) 

—  cc  otherwise 


Note  that  in  the  case  where  s  and  t  have  no  values  of  — ooor  +00  anywhere,  then  the 
definition  of  s  +  t  on  the  value  set  R_|_^  degenerates  to  the  definition  of  s  +  t  on  the  value 
set  R. 

The  generalized  image-template  operation  ®  generalizes  to  a  generalized  template- 
template  product.   Let  X  C  R"  be  finite,  X  =  {xj,  .  .  .  ,x„^},  and  let  7  be  an  associative 
binary  operation  on  the  value  set  F  with  global  reduce  operation  f  on  F^.   Let 
Fj,  F2,  and  F  be  three  value  sets,  and  suppose  0  :  Fj  X  F.,  — *■  F  is  a  binary  operation.   If  7 
is  an  associative  binary  operation  on  F,  t  G  (Fj^)^^',  and  s  G  (F.,^)^',  then  the  generalized 
template  operation  of  t  with  s  {induced  by  7  and  o)  is  the  binary  operation 
®  :(Fi^)Wx  (Ff)Y  defined  by 

t  @  8  =  r  G  (F^)^',  where 
tJx)   =      r  tjx)osy(w)  ,  y  G  Y,  X  G  X. 

Note  that  if  |X|  =  1,  then  the  definition  of  the  generalized  template  operation  oft  and  s 
degenerates  to  the  definition  of  the  generalized  backward  template  operation  of  the  image 
t  G  Fi^^  with  the  template  s  G  {FT^f,  and  r  G  F^*'.    If  I  YI  =  1,  then  the  definition  of  the 
generalized  template  operation  oft  and  s  degenerates  to  the  definition  of  the  forward  tem- 
plate operation  of  the  image  s  G  Fo^'  with  the  template  t  G  (Ff")^^,  where  r  G  F^. 

The  specific  cases  for  @  =  ®,  M  ,  or  @  thus  generalize  to  operations  between  tem- 
plates.  We  give  the  definitions  for  M  and  ® ,  and  refer  the  reader  to  another  reference  for 
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the  definition  of®  [31].   Let  t  €  (R;^)^  and  s  G  (R;^)'^.   Then  s  M  t    =  r  G  (RJJ^  is 
defined  by 

rj,(w)   =     V   ty(x)  +  s^(w) ,    where  w  G  W  . 

Again,  as  in  the  image-template  operations,  we  may  restrict  our  computation  to  a  subset  of 
X.   In  particular,  for  y  G  Y,  we  define  the  set 

S-oo(w)  =  {xe:iC:xe  S_Jt^.)  and  w  G  5_(sJ}. 
Then  r  =  s  M  t  G  (R^D"^'  is  defined  by 

where  we  define       V      ty(x)  +  s,^(w)  =  — oo  whenever  S_oo(w)  =  0. 

x6S_oo(w) 

The  operation  ®  has  a  similar  situation.   We  have  r  =s  ®  t  G  ((R^)^)"^  which  is 
defined  by 

r(w)=    V    tJx)s^(w), 

*  x6S(w)    ^  ^ 

where  we  define     V    t  (x)  ■  s,;(w)  =—oo  whenever  S(w)  =  0. 

x6S(w) 

It  follows  from  these  definitions  that  the  infinite  support  of  the  template  r  is 
5-co(r,.)  =  {wGW:    S_Jw)^0}. 

The  definitions  given  in  this  section  are  the  elemental  ones.   Further  definitions  that 
play  important  parts  in  the  theoretical  development  of  the  lattice  structure  of  the  image 
algebra  will  be  presented  as  needed. 

We  define  the  complementary  operations  of  Q  and  ®  for  templates  in  the  natural 
way.   Let  t  G  (R^j"^'  and  s  G  (R^D""^-   Then  s  Q  t  G  (R^D"^  is  defined  by 

s  Q  t  =  (t*  El  s*  )* 
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Similarly,  for  t  G  ((R+^)^)^'  and  s  G  ((R+^)^^')^,  s  ®  t  G  ((R+^)^^')^  is  defined  by 


8  ®  t  =  (t  ©  s ) . 

We  would  like  to  remark  upon  one  notational  deviation  between  the  Overview's  [31] 

definition  for  the  ®  operations  and  the  one  presented  here.   Let  R^^  = 

{r  G  R  :  r  >  0}  U  {  +  oo}.   In  the  Overview,  for  a  G  (R^)^'  and  t  G  ((R^)^)^',  the 

backward  multiplicative  max  transform  is  defined  as 

a  ®  t  =  {(y,b(y))  :  b(y)  =  V  a(x)  •  tj.(x),  y  G  Y} 

which  is  equivalent  to 

a  ®  t  =  {(y,b(y))  :  b(y)  =     V    a(x)t^.(x),  y  G  Y} 

x65(ty) 

with  b(y)  =  0  if  5(ty)  =  0.   The  difference  between  the  definition  given  earlier  and  this  one 
is  the  value  set,  namely  R^^  in  this  document  and  R.^  in  the  Overview.   The  number  0  acts 
as  a  lower  bound  in  R+oo  exactly  as  -co  acts  as  a  lower  bound  in  H^^.   Multiplication  of  the 
element  0  with  the  element  oo  follows  the  same  rules  as  multiplication  of  the  element  — oo 
with  the  element  oo  as  given  on  page  18.   In  other  words,  the  element  0  can  replace  symboli- 
cally the  element  —  oo.   The  main  advantage  of  using  the  number  0  instead  of  the  symbol 
—  oo  is  for  ease  of  machine  and  software  implementation.   Most  real  image  processing  data 
will  have  no  values  corresponding  to  the  symbol  +oo,  and  quite  often  have  non-negative 
values,  including  0  s.   Using  0  as  the  bottom  element  enables  that  value  to  be  represented 
easily  in  the  computer,  while  special  programming  methods  would  have  to  be  considered  to 
represent  the  symbol  — oo.   For  purposes  which  will  become  clear  in  the  course  of  this  docu- 
ment, we  have  remained  with  the  notation  R^^.   In  implementing  any  of  the  ideas  in  this 
dissertation,  if  the  value  set  at  hand  is  R^^^,  it  should  be  clear  that  the  symbol  — oo  can  be 
replaced  with  a  0  and  S__^{t{y))  replaced  by  5(t(y)),  so  that  representation  in  computers  may 
be  more  easily  accomplished. 
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1.2  Miiiiniax  Algcl)ra 

The  last  40  years  have  seen  a  number  of  clifFerent  autliors  discover,  apparently  indepen- 
dently, a  non-linear  algebraic  structure,  which  each  has  used  to  solve  a  different  type  of  prob- 
lem.  The  operands  of  this  algebra  are  the  real  numbers,  with  —oc  (or  +oo  adjoined),  with 
the  two  binary  operations  of  addition  and  maximum  (or  minimum).   The  extension  of  this 
structure  to  matrices  was  formalized  mathematically,  in  the  environment  in  which  the  above 
problems  were  posed,  by  Cuninghame-Green  in  his  book  Minimal  Algebra  [38].   It  is  well 
known  that  the  structure  of  R  with  the  operations  of  +  and  V  is  a  semi-lattice  ordered 
group,  and  that  (R,V,  A,  +)  is  a  lattice-ordered  grouj),  or  an  1-group  [35] .   Viewing  R_oo  a^ 
a  set  with  the  two  binary  operations  of  +  and  V,  and  then  investigating  the  structure  of  the 
set  of  all  n  X  n  matrices  with  values  in  R_ooi  leads  to  an  entirely  different  perspective  of  a 
class  of  non-linear  operators.   These  ideas  were  applied  by  Shimbel  [-15]  to  communications 
networks.   Two  authors,  Cuninghame-Green  [36,37]  and  Giffler  [-16]  applied  them  to  the 
problem  of  machine-scheduling.   Others  [47, 18, 49, •50]  have  discussed  their  usefulness  in  appli- 
cations to  shortest  path  problems  in  graphs.   Cuninghame-Green  gives  several  examples 
throughout  his  book  [38],  primarily  in  the  field  of  operations  research.   Another  useful  appli- 
cation, to  image  algebra,  was  again  independently  developed  by  G.X  Ritter  et  al.  [51]. 

In  fact,  the  notion  of  a  matrix  product  can  be  generalized  to  what  is  called  the  general- 
ized matrix  product  [39],  whose  definition  is  given  below. 

Let  F  denote  a  set  of  nund^ers.    Let  /and  g  l)e  functions  from  F  X  F  into  F.    For 
simplicity,  assume  the  binary  operation  /to  be  associative.    Let  F"^"''  denote  the  set  of 
all  m  x  p  matrices  with  values  in  F,  and  let  ( a|j )  =  A  G  F'"^  and  ( bj^ )  ==:  B  G  F^". 
Define  /•  g  to  be  the  function  from  F'"''  X  F''"  into  F""'  given  by 
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{f-9){\,B)   =  C, 

where  Cj^    =  (aji  <7biJ/(  a^o^f^k )/  '  '  '  f{%9\k)<  for  i  =l,-,m,  k  =  l,...,n,  and/ 

and  ^  are  viewed  as  binary  operations. 
Thus,  if /denotes  addition  and  g  multiplication,  then  {/■  g){A,B)  is  the  ordinary  matrix  pro- 
duct of  matrices  A  and  B.   Cuninghame-Green  develops  the  setting  for  a  formal  matrix  cal- 
culus based  on  the  two  binary  operations  +  and  V  of  the  extended  real  numbers,  analogous  to 
linear  algebra  which  uses  the  two  operations  of  multiplication  and  arithmetic  sum.   He  terms 
this  matrix  theory  minimax  matrix  theory.   The  development  of  the  theory  is  performed  in 
the  abstract,  with  an  eye  towards  applications  for  matrices  with  values  in  the  set  R^^o-   The 
importance  of  Cuninghame-Green's  work  to  the  image  algebra  is  that  not  only  is  the 
minimax  matrix  algebra  embedded  in  the  image  algebra  for  the  set  R^^  but  also  for  the  set 
R^^.   The  set  (R"'",V,  A,  *)  is  an  1-group  also.   An  image  algebra  transform  using  either  M 
or  ®  can  thus  be  viewed  as  a  matrix  transform  in  the  minimax  algebra  for  the  respective 
case  of  R^^  or  R^^o-   This  completes  the  mathematical  identification  of  the  three  main 
subalgebras  in  the  image  algebra.   The  linear  transforms  were  classified  by  Gader  [32]  who 
showed  that  linear  algebra  is  embedded  into  image  algebra.   As  a  result  of  each  embedding 
above,  the  full  power  of  the  respective  mathematical  theory  can  be  applied  to  solving  prob- 
lems in  image  processing,  as  long  as  the  image  processing  problem  can  be  formulated  using 
image  algebra  operations  of  ®,  M  ,  or  ©.   Since  it  has  been  formally  proven  that  the  image 
algebra  can  represent  all  image-to-image  transforms  (see  section  1.1),  the  embeddings  are 
very  useful  to  have. 

The  rest  of  this  section  is  devoted  to  introducing  the  basic  notions  of  the  minimax  alge- 
bra structure  and  properties. 


26 

1.2.1.    Ra.sir  Definitions  nnrl  Notation 

Let  F  be  a  semi-lattice  ordered  semi-group  with  semi-lattice  operation  V  and  semi- 
group operation  X.   Thus,  F  satisfies 

X  V  (  y  V  z  )  =  (  X  V  y  )  V  z  A^ 

X  V  y  =  y  V  X  A 

X  V  X  =  X  A 
as  it  is  a  semi-lattice,  as  well  as 

xX(yXz)=(xXy)Xz  A_^ 
as  it  has  an  associative  group  operation  X  ,  and 

xX(yVz)=(xXy)\/(xXz)  A^ 

(yVz)Xx=(yXx)V(zXx)  A^ 

as  it  is  an  ordered  semi-group.   We  call  this  structure  a  belt,  in  the  vein  of  rings.   The  opera- 
tion V  is  called  an  addition,  and  the  operation  X  a  nndlipiicalion.   We  shall  also  call  a  semi- 
lattice  an  s-lattice. 

Suppose  the  belt  F  also  satisfies  the  dual  to  axioms  Aj  through  Ag,  where  X'  is  another 
binary  group  multiplication: 

X  A  (  y  A  z  )  =  (  X  A  y  )  A  z  A'^ 

X  A  y  =  y  A  X  A'^ 

X  A  X  =  X  A'g 

X  X '  (  y  X '  z  )  =  (  X  X '  y  )  X '  z  A' 

xX'(y  Az)=(xX'y  )  A(xX'z  )  A'^ 

(y  Az)x'x=(y  X'x)  A(zX'x).  A'^ 
Here,  X'  is  called  a  dual  multiplication,  and  A  is  called  a  dual  addition.  The  (group)  multipli- 
cation or  dual  multiplication  is  not  assumed  to  be  commutative. 
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If  in  addition  to  the  above  12  axioms,  F  satisfies  the  following  axiom, 

xV(y  Ax)  =  xA(y  Vx)  =  x, 
then  F  is  a  belt  with  duality.   If  the  multiplication  X  and  dual  multiplication  X' coincide, 
then  we  call  the  multiplication  self-dual.   A  belt  with  duality  and  self-dual  multiplication 
corresponds  to  a  lattice-ordered  semi-group,  or  l-semi-group,  in  lattice  theory. 

Let  (FjjV)  and  (FojV)  be  twos-lattices.   A  function  f:  Fj  — ♦■  F.2  is  an  s-lattice 
homomorphism  if 

f(xVy)   -  f(x)Vf(y), 
for  all  x,y  G  F.   If  Fj  and  F.2  are  belts  and  f:  Fj  — ♦  Fo  is  an  s-lattice  homomorphism,  then  if 
f  also  satisfies 

f(x  X  y)    =   f(x)  X  f(y) 
for  all  x,y  G  F,  then  we  say  that  f  is  a  belt  homomorphism.   The  following  is  an  example  of  a 
belt  isomorphism.   Define  f:  R  — >■  R"*"  by 

f(x)   =  e^ 
Then  f(x  V  y)   =  f{x)  V  f(y),  and  f(x  +  y)   =  f(x)  *  f(y).   It  is  trivial  to  show  that  f  is  a  belt 
isomorphism. 

The  belts  R  and  R"^  are  commutative  belts,  that  is,  the  multiplication  X  commutes. 
Each  also  has  an  identity  element  under  the  multiplication,  namely  0  for  R  and  1  for  R"*". 
Because  they  are  groups,  each  element  r  G  F  has  a  unique  multiplicative  inverse;  we  call 
such  a  belt  a  division  belt,  by  analogy  with  division  rings.   A  belt  has  a  null  element  if  there 
exists  an  element  0  E  F  such  that 

VxGF,xV<?  =  x  and  xX  d^dx  x=e. 
The  belts  (R_oo,V,+)  and  ( Rl!"oo ,  V ,  + )  each  have  the  element  —oo  as  its  null  element. 
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A  division  belt  with  distinct  operations  X  and  V  and  with  duality  corresponds  to  a 
lattice-ordered  group,  or  1-group.   In  fact,  if  (F,  V,X  )  is  a  belt  with  distinct  operations  V 
and  X,  then  by  defining 

X  A  y  =  (  x-i  V  y-^  )~^  ,  V  x,y  G  F  (1-2) 

we  have  introduced  a  second  (dual)  s-lattice  operation  A  such  that  (F,V,A)  becomes  a  (distri- 
butive) lattice  [35].   In  our  terms,  the  division  belt  F  accjuires  a  duality  with  a  self-dual  mul- 
tiplication.  Our  main  interest  will  be  for  the  1-groups  (F,V,X  ,A,x')=(R,V,-l-,A,-|-) 
and  (R"'',V,  *  ,  A,  *),  *  representing  real  multiplication.   From  the  above  discussion,  it  fol- 
lows that  (R,  V,-l-,  A,-f )  and  (R^,  V,  *  ,  A,  *)  are  isomorphic  as  1-groups. 

An  arbitrary  1-group  F  having  two  distinct  binary  operations  V  and  X  can  be  extended 
in  the  following  way.   We  adjoin  the  elements  -|-oo  and  —oo  to  the  set  F  and  denote  this 
new  set  by  F^,^,  where  — oo  <  x  <  -f-oo  V  x  G  F.   We  define  a  multiplication  and  a  dual 
multiplication  in  F^^  by:    if  x,y  G  F,  then  x  X  y  is  already  defined.   Otherwise, 
X  X  — oo  =  —OCX  X  =  — oo,  X  G  F  U  {— oo} 
x  X  -\-<X)  =  -\-oox  X  =  +oo,  X  G  F  U  {+00} 
X  x'-oo  =  -oox'x  =  -oc,  X  G  F  U  {-oc} 
X  x'-i-oo  =  -foox'x  =+00,  X  G  F  U  {+00}. 

—  OCX  -l-oo  =  -|-oox  —00  =  — 00 
— ooX'-|-oo  =  -|-oox'— oo  =  -|-oo 

The  element  —00  acts  as  a  null  element  in  the  entire  system  {F^^,\/ ,X  )  and  the  element 
-hoo  acts  as  a  null  element  in  the  entire  system  (F^^,A,X').   However,  the  multiplications 
X  and  X'  are  asymmetric  between  the  elements  — oc  and  -l-oo.   The  elements  in  F  are  called 
the  finite  elements. 
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We  call  such  a  system  {F^^,y,X  ,A,X')  a  bounded  l-group,   and  F  is  called  the  group  of 
the  bounded  l-group  F^^. 

The  two  bounded  l-groups  (R^^,  V, +,  A, +')  and  (R_^^,\/,  *  ,  A,  *')  will  be  our  main 
concern.   Another  bounded  l-group  of  interest  is  the  3-element  bounded  l-group  with  group 
<j),  denoted  by  F3.    Note  that  the  boolean  algebra  ({— oo,(;^},\/,A)  is  embedded  in  Fg,  with  OR 
=  V  (maximum),  AND  =  A  (minimum),  FALSE  =  —oq,  and  TRUE  =  <j).   It  is  simple  to 
check  that  the  familiar  truth  tables  hold. 

Let  (F,V,X  )  be  a  belt,  and  let  (T,V)  be  an  s-lattice.   Suppose  we  have  a  right  multi- 
plication of  elements  of  T  by  elements  of  F: 

X  X  X  e  T  V  pairs  x,X,  x  €  T,  X  G  F. 

We  call  (T ,  V)  a  right  s-lattice  space  over  (F,V,X ),  or  just  say  T  is  a  space  over  F  if  the  fol- 
lowing axioms  are  satisfied  for  all  x,y  G  T  and  for  all  X,  ^/  G  F: 

( T ,  V)  is  an  s— lattice 

(xX  X)x  n  =  xX  (Xx  n) 

(xVy)x  X  =  (xx  X)V(yX  X) 

xX  (XV/i)=(xX  X)V(xX  n) 

and  if  F  has  an  identity  element  0, 

X  X  <l>  =  \. 

Such  spaces  play  the  role  of  vector  spaces  in  the  minimax  theory.   If  T  and  F  are 
known,  then  we  shall  simply  say  that  T  is  a  space. 

A  subspace  is  a  subset  of  a  space  which  is  itself  a  space  over  the  belt  F. 

Let  (S  ,  V),  (T,V)  be  given  spaces  over  a  belt  (F,V,X  ).   An  s-lattice  homomorphism 
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g:  (S,V)  — >■  (T ,  V)  is  called  right  linear  [over  F)  if 

g(  X  X  X  )  =  g(x)  XX    VxGS,VXeF. 

We  denote  the  set  of  all  right-linear  homomorphisms  from  S  to  T  over  F  by 
Homi-(S,T).   That  is, 

Homp(  S,T)  =  {g:S->-Tisa  homomorphism  and  g(x  X  X)  =  g(x)  X  XVxGS.VXGF}. 

Let  (F,V,X)  be  a  belt  and  (T,V)  be  an  s-lattice,  and  suppose  we  have  defined  a  left 
multiplication  of  elements  of  T  by  elements  of  F: 

X  X  X  G  T  V  pairs  x,X,  x  G  T,  X  G  F. 
The  left  variants  of  the  above  five  axioms  are  easily  stated.    We  define  a  system  satisfying 
those  left  axioms  a  left  space  over  F.   This  allows  us  to  define  a  two-sided  space.   A  two- 
sided  space  is  a  triple  ( L ,  T ,  R )  such  tJiat 

L  is  a  belt  and  T  is  a  left  space  over  L . 

R  is  a  belt  and  T  is  a  right  space  over  R. 

VXGL,  VxGTandV/fGR.Xx  (xX  ^,  )=(Xx  x)X  n. 

Let  (F  ,  V,  X  )  be  a  belt.   An  important  class  of  spaces  over  F  is  the  class  of  function 
spaces.   Here,  the  s-lattice  (T,V)  is  (F^,\/).   Such  spaces  are  naturally  two-sided.   We  shall 
only  be  interested  in  the  case  where  I  U|  =  n  G  Z"^.   A  space  (T ,  V)  is  of  form  (F  ",V),  and 
hence  our  spaces  F"  are  spaces  of  n-tuples. 

When  discussing  conjugacy  in  linear  operator  theory,  two  approaches  are  commonly 
used.   One  defines  the  conjugate  of  a  given  space  S  as  a  special  set  S   of  linear,  scalar-valued 
functions  defined  on  S.   The  other  involves  defining  an  involution  taking  x  G  S  to  x    G  S 
which  satisfy  certain  axioms.   (Recall  a  function  f  is  an  involution  if  f~^(f(x))  =  x.)  The  situa- 
tion is  slightly  more  complicated  in  the  case  of  lattice  transforms. 
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Let  (S,V,X)  and  (T,A,x')  be  given  belts.   We  say  that  (T,A,x')  is  conjugate  to 

(S  ,  V,  X )  if  there  is  a  function  g:  S  — ♦■  T  such  that 

g  is  bijective  C 

Vx,yGS,g(xVy)   =  g(x)  A  g(y)  C^ 

V  x,y  G  S  ,  g(x  X  y)    =  g(y)  x'  g(x) .  Cg 

In  lattice  theory,  g  is  called  a  dual  isomorphism.   Note  that  conjugacy  is  a  symmetric 

relation.   If  (S  ,V,  A)  is  an  s-lattice  with  duality  satisfying  the  first  two  axioms,  then  we  say 

that  S  is  self-conjugate.   If  (S,V,X  ,A,X')  a  belt  with  duality,  we  say  that  (S,V,X  ,A,x')  is 

self-conjugate  if  (S,A,x')  is  conjugate  to  (S,V,X). 

In  particular,  every  division  belt  is  self-conjugate  under  the  bijection  x*  =  x~\  and 
every  bounded  1-group  is  self-conjugate  under  the  bijection  {—oof  =  -{-oo,  (+00)*  —  —00,  and 
x    =  x~^  if  X  is  finite. 

I.2.2.    VTatriv  Algebra 

We  now  present  the  extension  of  the  belt  operations  to  matrices.   Let  (F  ,  V,  X  )  be  a 
belt.   Let  M^^  be  the  set  of  all  m  x  n  matrices  with  values  in  the  set  F,  and  let 
s  =(sjj),  t  =(tij)  G  Xjnn-   Then  we  define 

(sij)V(tij)   ^   (sijVtij) 
and  for  (sjj)  G  M^^,,  (tjj  G  M^,„  we  have 

(sii)x  (tjj   =  (.^JsijXtj,])    GA1^„. 

Suppose  s  G  Mj^^  and  t  G  M[,q.   We  say  that  s  and  t  are  conformable  for  addition 
whenever  both  m  =  h  and  n  =  q,  and  conformable  for  multiplication  whenever  n  =  h.   For 
the  remainder  of  this  presentation,  we  use  the  notation  F"  and  M^^^,  as  defined  above.   Also, 
we  call  an  n-tuple  or  a  matrix  finite  if  all  its  elements  are  finite,  i.e.  not  equal  to  either 

+00  or  —00. 
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If  (F  ,  V,  X  ,  A,  X')  is  a  belt  with  duality,  then  we  say  that  a  space  (T ,  V)  over  F  has  a 
duality  if 

a  dual  addition  A  is  defined  where  (T,V,  A)  is  an  s— lattice  with  duality; 

(T,A)  is  a  space  over  the  belt  (F,A,X'). 
We  also  have  a  dual  matrix  addition  and  dual  niultiplication  defined  for  matrices  over  a  belt 

with  duality. 

(sij)A(tij)  =  (sijAt,^) 
and  for  (sjj)  G  M„,h,  (tjj  G  M,,„,  we  have 

(sij)x'(t3J   ^  (,A[sijX'tj,])   GA1,„ 
with  the  expressions  conformable  for  dual  addition  A  and  conformable  for  dual  multiplication 
x'  used  in  the  obvious  way. 

Let  (F,  V,X  )  be  a  belt  and  let  Mp,^  denote  the  set  of  p  x  q  matrices  with  values  in  F. 
The  following  are  some  basic  properties  that  are  proven  in  [38]. 

(1)  (Atnin)V)  is  an  s-lattice  and  (Mnp,V)  is  a  function  space  over  (F,V,X); 

(2)  (M„„,V,X)isabelt; 

(3)  (Mnp'V)  is  a  left  space  over  the  belt  (Ai„„,\/,X ); 

(4)  Al„p  is  a  right  space  over  the  belt  F; 

(5)  Scalar  multiplication  of  a  matrix  s  by  an  element  X  G  F  is  defined  by 

(sij)x  X   =  (sijX  X) 
\X  (Sij.)    =   (Xx  Sjj) 
forall(sij)G  A<„p,  X  G  F; 

(6)  ForallsG  Aln,„,  t,uGM„p,  XGF, 
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sX  (tVu)=(sX  t)V(8X  u) 
8X(tXX)=(sXt)xX. 

Since  the  s-lattice  (A(ni,V)  is  isomorphic  to  the  s-lattice  F",  we  have  F"  is  a  function 
space  over  F  as  well  as  a  space  over  M^„.   This  mimics  the  classical  role  of  matrices  as  linear 
transformations  of  spaces  of  n-tuples! 

Two  important  matrices  in  our  present  setting  are  the  identity  matrix  and  the  null 
matrix.  Suppose  the  belt  F  has  identity  and  null  elements  (f>  and  -co  respectively.  We 
define  the  identity  matrix  e  G  M^„  by 


and  the  null  matrix  ^  G  M^„  by 


*    = 


Thus  we  have  V  s  G  >(„„  and  for  4>  G  Af„„, 

eX  s=8X  e=s 

s  \/4>  =s 
sX  4)=4>X  s=<I>. 

In  the  bounded  1-group  R^^^  we  have 


0 

0 

—  CO    . 

—  CO 

■     0. 
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and  in  'R.^^  we  have 


Conjugacy  extends  to  matrices  if  the  underlying  value  set  is  itself  a  self-conjugate  belt. 
This  is  stated  in  the  next  proposition. 

Proposition  1.1  [38].    //(F,\/,X  ,A,x')  is  a  self-conjugate  belt,  then  (M^^y ,X  ,/\,x')  is 
a  self-conjugate  belt. 

In  linear  algebra,  we  characterize  linear  transformations  of  vector  spaces  entirely  in 
terms  of  matrices.   Are  we  able  to  do  a  similar  classification  here?  The  following  results  give 
necessary  and  sufficient  conditions  for  this  to  be  the  case. 

Theorem  1.2  [38].    Let  F  be  a  belt  which  has  an  identity  element  (f>  with  respect  to  X  and  a 
null  element  6  with  respect  to  — oo.    Then  for  all  integers  m,n  >  1,  M^„  is  isomorphic  to 
HomFfF^.F""). 

Corollary  1.3  [38].    LetF  be  a  belt,  and  let  n  >  i  be  a  given  integer.    Then  a  necessary 
and  sufficient  condition  that  M^^^  be  isomorphic  to  IIomj-(F",F'")  for  all  integers  n,m  >  1  is 
that  F  have  an  identity  element  (j)  with  respect  to  X  and  a  null  element  9  with  respect  to  \J. 
We  call  a  matrix  s  G  M,,,„  a  lattice  transform. 

Many  of  the  results  that  were  stated  in  Cuninghame's  book  can  be  viewed  in  in  context 
of  a  dual  lattice-ordered  semi-group,  which  has  been  extensively  researched  [35].   However, 
we  wish  to  study  the  structure  from  a  dili'erent  perspective.   The  extension  of  the  belt  opera- 
tions to  matrices  allows  us  to  view  matrices  as  operators  on  spaces  of  n-tuples,  in  a  way  simi- 
lar to  vector-space  transformations.   Tliese  operators  are  non-linear  due  to  the  lattice 
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structure  of  the  underlying  set  F.   Thus,  we  may  study  this  particular  class  of  non-linear 
transforms  in  a  mathematically  rigorous  setting,  and,  since  an  image  can  be  viewed  as  a  vec- 
tor and  a  template  as  a  matrix  (as  will  be  shown  in  Chapter  2),  apply  results  from  the 
minimax  matrix  theory  directly  to  solve  image  processing  problems.   For  example,  decompo- 
sition of  matrices  corresponds  to  decomposition  of  templates.   This  particular  application  is 
discussed  in  Chapter  5. 


CHAPTER  2 
THE  ISOMORPHISM 


In  his  Ph.D.  dissertation,  P.  Gader  showed  that  linear  algebra  can  be  embedded  into 
the  image  algebra  [32].   One  very  powerful  implication  of  this  is  that  all  the  tools  of  linear 
algebra  are  directly  applicable  to  solving  problems  in  image  processing  whenever  the  image 
algebra  operation  ©  is  involved.   We  now  show  an  embedding  of  the  minimax  algebra  into 
image  algebra  for  the  two  cases  where  the  belts  are  R  and  R"*".   We  employ  the  same  func- 
tions ^  and  u  as  used  by  Gader  in  his  dissertation. 

Let  X  and  Y  be  finite  arrays,  with  |X|  =  m  and  I Y]  =  n.   Assume  the  points  of  X  are 
labelled  lexicographically  Xj,Xo,  •■■,x„.,.   Assume  a  similar  labelling  for  Y;  Y  =  {yi,y2,  ■•■,yn  }■ 
Let  R^oo  have  its  usual  meaning.   Let  R^^^o  =  {(xj,X2,...,x^, )  :  Xj  €  R±oo  }■   That  is,  R^^o  is 
the  set  of  row  vectors  of  m-tuples  with  values  in  Rj.oo-   Let  a.  G  R^,  i^^-a  denote  the  set  of 
m  X  n  matrices  with  values  in  R^oo,  and  define  i>  :  R^o^  —*■  R±oo  by 

u{a)  =(a(xi),...,a(xj). 
Define  ^  :  (R^^)^  -.  M„,„  by 

^(t)=Mt=(p;j),  where  Pij=ty/Xi). 
Note  that  the  j-tli  column  of  M^  is  simply  (i^(tj))',  the  prime  denoting  transpose. 

In  the  following  lemmas,  we  assume  that  I  X|  =  m,  I  Yl  =  n,  and  I  W|  =  /.    We  claim 
the  following: 

Lemma  2.1.   i^(a  M  t)=i/(a)x  ^(t), /or  t  G  (R^j''',  a  G  R^. 
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Lemma  2.2.   i^(a  V  b)  =  i/(a)  V  i^(b),  a  G  F^^,  F  G  {R,R+}. 
Lemma  2.3.    vl'(s  M  t)  =  ^(s)  X  vI/( t ), /or  s  G  ( R^J ^^ ,  t  G  ( R^^) ^'. 
Lemma  2.4.   ^(sVt)  =  >I'(s)  V  *(t),  s,t  G(F^J\F  G  {R,R+}. 

The  proofs  are  given  below. 
Proof  to  Lemma  2.1. 

We  must  show  that 

(aM  t)(y,)    =  (i/(a)X  ^t)\. 
First  note  that  i'(a  M  t)  is  a  1  x  n  row  vector,  as  is  i/(a)  X  *(t).   We  have 

(aM  t){yj   =     y  a(x)+yx)    =  ,9  a(xi)  +  t^Jx^ • 

xfcX  "  1=1  " 

AIso,(i.(a)X  *(t))k   =   .p^(Ka))j+(*(t)V    =   .^^ a(xj)  +  y Xj). 

Q.E.D. 
Proof  to  Lemma  2.2. 

At  location  x,;,  the  image  a  V  b  has  value  a(x|^)  V  h{x^.).   At  location  k,  the  row  vec- 
tor//( a)  V  i/(b)  has  value  (i^{  a)  ),^    V  (i/(b))t.  =a(xj  Vb(x|;). 


Q.E.D. 


Proof  to  Lemma  2.3. 

Here,  s  G  (R^L,)^^  and  t  G  (R^L)'''  implies 


and 


""^H   =     X,,Vw)+«w(xi)   =    Vt  K)+s    (Xi). 

'  wtW       '  k=l      '  "• 

Now,  let  *(s)  X  ^(t)  =  u  G  M,„n.   We  have 
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Q.E.D. 
Proof  to  Lemma  2.4. 

Here,  s,  tG(R^;,)^'.  Then 

(svtyxo  =  s,/xOvt,/xi), 

while 

Q.E.D. 
In  order  to  prove  the  isomorphism  theorem,  we  will  use  the  following  lemma. 

Lemma  2.5.    4'(t*)   =  mt))*,  t  e  {F^J^\  where  F  denotes  either  R  or  R+.    In  this 
particular  instance  we  let  t    denote  the  conjugate  template  o/t  G  (F^)^. 

Proof:  Let  s  =t*.   Then  s  G  (F}J^',  and 

*(t*)   =   Ms)   =  M,   =  (p.j),  where  Pij=s,/yi)=(t*),/y0  =  [(yxj)]*, 
while 

xl/(t)    =  Mj   =  (qij),  where  ciij=ty/xi). 
Obviously, 

Pij  =  [y''j)]'  =  ifijii*- 

Thus, 

andwehavevl'(t')   =  Al,   =  (MJ*    =  (^(t))'. 

Q.E.D. 

The  following  theorem,  along  with  Lemmas  2.1  through  2.4,  show  how  the  embedding 
of  the  minimax  algebra  into  the  image  algebra  is  accomplished. 


39 


Theorem  2.6.   For  a  finite  array  X,  with  |x|  =  m, 

{  R^,V,  A;(R^J^',  Ea  ,  V,  EI  ,  A  ;  M  ,  E3  }  «s  isomorphic  to 

where  H^^  is  the  set  of  all  m  x  m  matrices  with  entries  in  the  bounded  l-group  R^^. 

Proof:  By  Lemma  2.1,  u  preserves  image-template  multiplication,  and  by  Lemma  2.2,  v 

preserves  the  image-image  pointwise  ma.ximum  operation.   By  Lemmas  2.3  and  2.4, 
for  X  =  Y  =  W,  4'  preserves  the  operations  of  M  and  V  between  templates.   Let 
1  G  (R^^)'   denote  the  identity  template  defined  by 

/      0         if  y  =  X 

lv(x)    =    1  .1         •       ■ 

y^  '  y    —GO      otherwise 

It  is  trivial  to  show  that  ^(1)  =  e  G  Alp,,^,  the  identity  matrix  in  A<mm- 

We  now  show  that  the  operations  of  Q  and  A  are  also  preserved  under  ^.   It  is  not 
difficult  to  show  that  *(s At)  =  *(s)  A  *(t).   Letr=sAt.   Then 
^(r)  =  M,  =  ( mij )  =  ( Ty/Xi) ),  where  r^/xi)  =  Syj(xi)  A  t./x;).   Thus, 

vI'(s)A*(t)   ^  M,AM,   =  (9,/xi))A(yXi))   =  (s,/xi)At,/Xi))   =  (r,.(xO). 

By  definition,  s  E3  t  =  (t*  M  s*)*,  and,  using  Lemma  2.5  with  F  =  R,  Lemma  2.3, 
and  property  C3,  we  have 

*(s  IZ3  t)   =  xl/((t*  M  s*)*)   =  [vl/(t*  0  s*)]*    =  (M'(t*)  X  *(s*))* 
=  (*(s'))*x'(xl'(t*))*    =   ^(s)x'vl/(t). 
Thus,  >I'(8E1  t)   =  *(s)x'*(t). 

It  is  straightforward  to  see  that  v  is  on-to-one  and  onto  R^^oo-   To  show  that  ^  is 
one-one  and  onto  H.^^,  let  s ,  t  E  (R^)^  and  suppose  that  ^(s)  =  ^(t).   Then 
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(^(s))ij    -  (MJij    =  Sy/Xi)   =  t^,(Xi)   -  (MJ;^   =  (*(t))ij,  and,  thus, 

s  (xj)    =  t  (Xj)   for  all  j  =  l,...,ii,  and  for  all  i  =  l,...,m. 
So  *  is  one-to-one  as  s  =  t.   Let  M  =  ( 111- )  G  M,^^„.    Define  t  G  ( R^) ^  by 
ty  (xj)  =  mjj.   Then  ^(t)  =  M.   Setting  m  =  n,  we  see  that  ^  is  one-one  and  onto 

Q.E.D. 

Thus,  the  minimax  algebra  with  the  bounded  1-group  R^^^  is  embedded  into  image  alge- 
bra, by  the  functions  ^~^  and  u~^.   As  the  bounded  1-group  R^^  is  isomorphic  to  the 
bounded  1-group  R^^^,  the  minimax  algebra  with  tlie  bounded  1-group  R^^  is  also  embedded 
into  the  image  algebra.   In  this  case,  the  matrix  operation  X  corresponds  to  the  image  alge- 
bra operation  ® .   The  isomorphism  result  is  stated  in  Theorem  2.9. 

Let  X  and  Y  be  finite  arrays  as  before.   Let  R^^  have  its  usual  meaning,  a  G  (R^oo)''^, 
Mj„j^  denote  the  set  of  m  x  n  matrices  with  values  in  R^^  and  let  (R^^)™  = 
{(xi,x.„...,x^)  :  Xi  G  R+^  }.   Define  u  :  (R  +  ,f  -^  (R^oo)'"  in  the  usual  way  by 

i/(a)=(a(xi),...,a(xj). 
Define  *  :  {{R+J^)^  -^  A^rnn  as  before  by 

*(t)-Mt-(pij),  where  Pij=ty,(xi). 
In  the  following  lemmas,  we  assume  that  lx|  =  m,  I  Y|  =  n,  and  |w|  =  /.   We  claim 
the  following,  for  a,  b  G  (R+00)^: 


Lemma  2.7.    //(a®  t)  -f/(a)x  ^(t), /ort  G((R+  )^ 


'±00  } 


Lemma  2.8.   ^1/(8©  t)  =  ^^(s)  X  vl'(t), /ors  G  ((R+„)^)^^,  t  G  ((R+^)^^' 


'±00/ 
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Proof  to  Lemma  2.7. 

We  must  show  that 

(a©tXyK)    =  (t^(a)X  *(t)),. 
We  have 

(a®t)(y,)   =     y  a(x)*t,^(x)    =    ^  a(xi)  *  t    (x^) . 
x6X  "^  1=1  '" 

Also,(i.(a)X  ^t)),    =  .^(^(a))^*(vl/(t))j,    =   .*y  a(xj)  *  t,^(xj) 

Proof  to  Lemma  2.8. 

Here,  s  €  ((Ri,)^')^  and  t  e  {{R^J^'Y  implies 


1+    ^X^Y 
and 


8®t  =  reHR^j'^y 


Q.E.D. 


Now,  let  *(s)  X  xl/(t)  =u  G  M^^.    We  have 

Uij    =    V^(^(8))„*(vl/(t)),j    =    V^s4xO*t,/w,)    =  ^^^t,.(w,)*s4xi). 

Q.E.D. 

Theorem  2.9.    For  a  finite  array  X,  iotY/i  1x1  =  m, 

{  {Rtof,y,/\;{Koof)^,  ®  ,  V,  ®  ,  A  ;®  ,®  }  2S  isomorphic  to 
{(R+^r,V,A;Ai  ,,,„,, x,V,x',A;X,x'}, 
where  M^^  is  the  set  of  all  m  x  m  matrices  with  entries  in  the  bounded  l-group  R^^. 

Proof:  By  Lemma  2.7,  i^  preserves  image-template  multiplication,  and  by  Lemma  2.2,  v 

preserves  the  image-image  pointwise  maximum  operation.   By  Lemmas  2.8  and  2.4, 
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for  X  =  Y  =W,  ^  preserves  the  operations  of  M  and  V  between  templates.   Let 
1  G  ((R^^)-^)^  denote  the  identity  template  defined  by 


1         if  y  =  X 

lv(x)    =   1  ,,        ■ 

y"-  ''  '    — oo      otherwise 


It  is  trivial  to  show  that  4'(1)  =  e  G  Mmnr  ^^'^  identity  matrix  in  M^^  over  R^^. 

In  Theorem  2.6,  the  proof  that  ^(sAt)  =  4'(s)  A  *l'(t)  was  not  dependent  on  the 
value  set  R^<^,  and  hence  is  true  also  for  templates  s,  t  G  ((R^^)-'^)^.   We  now 
show  that  the  operation  of  ®  is  also  preserved  under  ^.   By  definition,  s  ®  t  = 


(t  ©  s),  and,  using  Lemma  2.5  with  F  =  R"*",  Lemma  2.8,  and  property  Cg,  we  have 


^s®  t)    =   *((t©i))    =    [^(t©  i)f    =    [^(t)x  vl/(s)]* 
=   (*(i))*X'(^(t))*    =    ^(s)x'vl/(t). 
Thus,  ^(s®t)    =   ^I'(s)x'*(t). 

We  use  the  fact  that  Theorem  2.6  showed  ^  and  u  are  one-one  and  onto  and  also 
that  R^oo  3-"^  R^oo  ^'"^  isomorphic  as  bounded  1-groups,  and  we  are  done. 

Q.E.D. 
We  have  shown  that  the  minimax  algebra  with  two  different  interpretations  for  the 
bounded  1-group  F^^^  with  group  F,  namely  F  =  R  and  F  =  R"*",  is  embedded  in  the  image 
algebra.   Using  the  notation  R^^  instead  of  R^^  allows  the  reader  to  regard  the  value  sets 
R^^  and  R.^^^,  as  basically  the  same  (they  are  isomoriJJiic  as  belts),  without  shifting  gears 
from  using  0  in  one  as  the  bottom  element  and  — oo  in  the  other.   All  minimax  properties 
stated  in  Cuninghame-Green's  book  will  be  valid  in  the  correct  context  of  image  algebra 
notation. 
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In  using  the  minimax  algebra  results,  we  would  like  to  point  out  that  the  the  matrix- 
vector  multiplication,  multiplication  of  a  matrix  by  a  vector  from  the  right,  is  used  mostly 
throughout  Cuninghame-Green's  book.   Left  multiplication  is  mentioned  at  various  places, 
and  in  fact,  most  left  variants  of  the  right  multiplication  results  will  hold.   However,  for  the 
most  part  in  our  applications  to  image  algebra,  we  will  be  using  the  right  multiplication  form 
in  the  development  of  our  theory.   The  functions  ^  and  //  map  the  image  algebra  expression 
a  M  t  =  b  to  the  matrix  algebra  expression  f  (a)  X  4'(t)  =  ^(b),  the  left  multiplication  form 
which  we  have  omitted  in  our  presentation  of  Cuninghame's  material.   The  following 
diagram  in  Figure  5  explains  how  we  will  be  taking  advantage  of  the  minimax  algebra 
results. 


a  □  t 


u{a.)  X  *(t) 


■•■  ±00 


'JfJ 


M 


M 


M 


'  pm  y 


(4'(t))'x(z/(a))' 


Figure  5.   How  the  Transpose  is  used  in  Conjunction  with  the  Isomorphism. 


Let  Tdenote  the  function  that  takes  a  matrix  to  its  transpose  as  well  as  the  function  that 
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takes  a  template  to  its  transpose.   Thus,  T:  M,„„  — >■  A(„,„  is  defined  by 

T(a)    =   a', 
the  prime  denoting  as  usual  the  transpose  of  a  matrix,  and  T:  (F"^)^  — >•  (F^  j"^  is  defined 

by 

T(t)  =  t'. 
Obviously,  ^(T(t))  =  T(^(t)).   In  a  clockwise  manner,  the  functions  u  and  ^  take  the  pro- 
duct i^(a  M  t)  to  v{a.)  X  ^(t),  which  is  the  matrix  ^(t)  multiplied  on  the  left  by  the  row 
vector  t'(a).   Applying  the  transpose  to  z^(a)  X  4/(t),  we  get  T[t^(a)  X  ^(t)]  = 
['l'(t)]'  X   [i'(a)]',  which  is  the  matrix  [^(t)]'  €  Mn^  multiplied  on  the  right  by  the  column 
vector  [^'(a)]'.   We  now  use  our  minimax  algebra  theorems,  where  matrix-vector  multiplica- 
tion is  the  matrix  multiplied  on  its  right  by  a  column  vector.   After  getting  the  desired 
results,  we  continue  on  around  the  diagram  clockwise,  mapping  back  by  the  transpose  T 
again  and  then  by  i>~^  or  ^~^   Formally,  if  d  represents  the  column  vector  which  is  the 
result  of  applications  of  minimax  algebra  theorems  to  the  initial  column  vector 
(^(t))'  X  (i'(a))',  then  u~\T{6))  will  be  an  image.  A  similar  situation  holds  for  templates. 

The  minimax  algebra  results  are  stated  in  the  usual  matrix-vector  multiplication  order, 
and  the  isomorphisms  ^  and  v  are  used  along  with  the  transpo.se  Tto  apply  the  matrix 
results.   When  the  word  isomorphism  is  used  in  this  context,  it  will  mean  the  above  functions 
^  and  u  explicitly  (not  with  the  transpose)  unless  otherwise  stated,  with  images  as  row  vec- 
tors and  templates  as  matrices  with  images  t    as  columns. 


PART  11 
MINIMAX  APPLICATIONS  TO  IM\GE  ALGEBRA  AND  IMAGE  PROCESSING 

The  objective  of  the  chapters  in  Part  II  is  to  sliow  how  the  minimax  algebra  can  be 
used  to  extend  basic  matrix  algebraic  results  in  such  a  way  as  to  have  applications  in  image 
processing.   The  tool  that  makes  the  minimax  algebra  useful  in  image  processing  is  the  iso- 
morphism between  the  image  algebra  and  the  minimax  algebra.   Before  the  research 
presented  in  this  dissertation  was  conducted,  the  relationship  between  the  image  algebra  and 
the  minimax  algebra  had  not  been  established.   The  power  of  the  isomorphism  is  that  it 
makes  all  results  in  the  minimax  algebra  applicable  to  solving  image  processing  problems, 
just  as  linear  algebra  results  are  applicable  to  solving  image  processing  problems.   For  exam- 
ple, template  decomposition  is  presently  a  very  active  area  of  research.   The  problem  of  map- 
ping transforms  to  some  types  of  parallel  architectures  is  equivalent  to  decomposing  a 
transform  t  into  a  product  of  transforms  t  =  t^  0  t"  M    ■  •  •    13  t  ,  where  each  factor  t'  is 
directly  implementable  on  the  parallel  architecture.   Since  decomposing  templates  is  the 
same  as  decomposing  matrices,  matrix  decomposition  techniques  can  be  applied  to  template 
decomposition  problems.   Thus  far,  there  exist  no  decomposition  techniques  for  matrices 
under  the  matrix  operation  X  as  presented  in  section  1.2.   Hence,  the  methods  developed  in 
Chapter  5  that  decompose  matrices  are  new  results.   They  were  developed  mainly  for  solving 
the  problem  of  mapping  of  transforms  to  particular  parallel  architectures,  though  they  stand 
by  themselves  as  a  new  theoretical  result  in  the  minimax  algebra. 

While  some  other  areas  of  minimax  algebra  may  seem  to  have  no  current  applications 
to  image  processing,  such  as  the  eigenproblem,  we  present  them  in  their  image  algebra  form 
due  to  their  interesting  mathematical  results. 
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CHAPTER  3 
MAPPING  OF  IvDNIMAX  ALGEBRA  PROPERTIES  TO  IMAGE  ALGEBRA  PROPERTIES 


This  chapter  is  devoted  to  describing  algebraic  properties  of  the  substructures 
{(F^)"^',  F^,  M  ,\/,  0  ,  A},  where  F  is  a  subbelt  of  R^^  or  R+^.   During  the  investigation 
of  the  properties  and  before  the  discovery  of  the  link  to  minimax  algebra,  many  basic  proper- 
ties, such  as  the  associativity  of  the  M  operation,  were  proven  within  the  context  of  the 
image  algebra.   Many  theorems  had  excessive  notational  overhead,  and  often  the  proofs  were 
laborious.   Most  of  these  same  properties  were  found  to  have  been  stated  and  proven  in  con- 
text of  the  minimax  algebra  [38].   Using  the  matrix  calculus  makes  some  proofs  less  tedious, 
and  in  some  cases  makes  them  less  cumbersome  notationally.   Thus,  in  order  to  place  the 
presentation  in  a  more  elegant  mathematical  environment,  we  are  omitting  proofs  that  were 
done  in  the  image  algebra  notation,  and  shall  make  use  of  the  isomorphisms  given  in  the  pre- 
vious chapter.   Most  of  the  theorems  presented  here  are  mapped  into  image  algebra  notation 
using  the  isomorphisms,  and  the  proofs  will  be  omitted.   The  results  will  be  stated  for  both 
bounded  1-groups,  using  the  operations  M  and  @ . 

3.1.    Basic  Definitions  and  Properties 

Unless  otherwise  stated,  we  shall  assume  that  X,  Y,  and  W  are  finite  coordinate  sets, 
with  |X|  =  m,  I  Y|  =  n,  |W|  =  k,  with  the  pixel  locations  lexicographically  ordered  as  in 
Chapter  2.   The  belt  F  with  duality  is  a  subbelt  of  either  R^^  or  R^^o-   The  templates  s  and 
t  will  be  F  valued  templates  on  appropriate  domains,  and  a,  b  will  be  F  valued  images.   For 
the  appropriate  subbelt  F  of  R^^  or  R^^  according  to  the  operation  M  or  © ,  respectively, 
we  have  the  following  basic  properties. 
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(1)  ((F^)^',V)  is  an  s-lattice  and  ((F^j'^'.V)  is  a  function  space  over  (F,V,X); 

(2)  {(F^')^,V,  M  }isabelt;  {(F^')^,V,®  }  is  a  belt; 

(3)  (( F^ )  '^' , V)  is  a  left  space  over  the  belt  (( F^ )  '^'  ,V)  is  a  left  space  over  the  belt 
((FX)^,V,E1);                                                 ((F^')^,V,®); 

(4)  (F^)^  is  a  right  space  over  the  belt  F; 

(5)  We  define  scalar  multiplication  of  a  template  t  €  (F    )^  by  a  scalar  X  G  F  as  multipli- 
cation by  the  one-point  template  X  G  (F^)-'^  or  X  G  (F^^)^,  depending  on  whether 
the  template  X  multiplies  from  the  left  or  from  the  right,  respectively,  (and  adjoining 
—  GO  to  F  if  necessary),  as 

tMX   =  XMt   =se  (F>J^',  where  Sy(x)  =  ty(x)  +  X 
and 


t©X  =   X®t=8e  (Ff^J^  ,  where  Sy(x)  =  ty(x)  *  X. 

f  X         if  X  =  y 

Here,  \,{x)  =\  ,.1,        •    • 

'    !/^  '  —00      otherwise 


Next  we  state  the  distributive  properties  of  M  and  ©  with  respect  to  V- 

(6)  a  M  (t  V  s)  =  (a  El  t)  V  (a  M  s)  a  @  (t  V  s)  =  (a  ®  t)  V  (a  ®  s) 
a  M  (t  M  s)  =  (a  M  t)  M  8  a  ®  (t  0  s)  =  (a  ®  t)  ®  s 
(aVb)  M  t  =(a  M  t)V(b  M  t)  (a  V  b)  ®  t  =  (a  ®  t)  V  (b  ®  t) 
(s\/t)Hu=(8Mu)\/(tiau)  (sVt)®u=(s®u)V(t®u) 
uM(s\/t)=(uEls)V(u|21t)  u®(sVt)=(u®s)V(u®t) 
8  M  (t  M  u)  =  (s  M  t)  M  u  s  ®  (t  ®  u)  =  (s  ®  t)  ®  u. 

The  dual  to  properties  1  througli  6  also  hold,  iis  both  the  belts  R  and  R"*"  have  duality. 

(7)  ((F^)^',  A)  is  an  s-lattice  and  ((F^)"*',  A)  is  a  function  space  over  (F,  A,x'); 

(8)  {(F-'^'j^.A.IZg  }isabelt.  {(F^)^'^\  A,®  }  is  a  belt, 
etc. 
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Now  let  F  be  a  subbelt  of  R  or  R"*",  and  F^^^  the  bounded  1-group  with  group  F. 
Corresponding  to  the  identity  matrix  and  the  null  matrix  we  have  the  identify  template 
1G(F^J^  defined  by 

(6        if  X  ==  y 
—  oc      otherwise 

and  the  null  template  4>  G  (F^)^  defined  by 

4>y(x)   =  -oc  ,  for  all  y  G  Y,  X  G  X. 
For  the  belt  R,  ^  =  0,  and  for  the  belt  R"*",  (^  =  1.   Thus  we  have 


aMl=a,     t  M  1  =1  M  t  =t  VaGR^^,  Vt  G(R 


X     w+  c  ^dX  ^x 


±00/ 


For<I>  G(F^)^', 


■±oo7      • 


tV<J=t,     t|2|*=4>igt=4>,     a  M  4>  =  null  image,  VaGR^,Vt  G(R 
Similar  properties  hold  for  the  operation  ®  • 


3.1.1 Homomorphisms 

We  now  discuss  homomorphisms  in  context  of  the  image  algebra.  Let  |x|  =  m.  Since 
the  &-lattice  {F^,  V}  is  isomorphic  (via  ly)  to  the  s-lattice  {F^'q^.  V},  {F^,  V}  is  a  space. 
For  X  G  F"   the  constant  image,  we  have 

aVX   =  XVa   =  he  F^^,,  where  b(x)  =  a(x)  V  X, 
and  for  the  one-point  template  X  G  (Ri^)^, 

aiaX   =   X|2la   =  bG  F^,.^,  where  b(x)  =  a(x)  +  X, 
if  F  =  R,  and 

a©X   =   X®a   =  bG  F^,  where  b(x)  =  a(x)  *  X, 
if  F  =  R"*".   Let  F  G  {R^oo>  ^^col-   Since  {F    ,  V}  is  an  s-lattice,  an  s-lattice  homomorphisrr 


49 


piX  .„  -tY 


from  F^  to  F*^  is  a  function  f:  F^  —*■  F*  satisfying 

f(aVb)   -  f(a)Vf(b). 
A  right  linear  homomorphism  g:  F     —*  F     is  an  s-lattice  homomorphism  satisfying 

g(a  0  X)   =  g(a)  M  X. 
Thus,  the  set  of  all  right  linear  homomorphisms  from  F"'*'  to  F^  is  denoted  by 

Homp(F^^F^)  =  {g:F^-^F^'  , and  g  satisfies  g(aVb)=g(a)Vg(b),g(aM  X)=  g(a)  M  X}, 
or  if  F  is  R"*",  then 

HomF(F^,F^)  =  {g:F^-*F^  ,and  g  satisfies  g(aVb)=g(a) Vg(b),g(a®  X)=  g(a)®  X}. 

3.1.2.    Classification  of  Homomorphisms  in  the  linage  Algehra 

Right  linear  transformations  can  be  characterized  entirely  in  terms  of  template 
transformations,  and  we  give  necessary  and  sufficient  conditions  for  (F''^)^  to  be  isomorphic 
toHomF(F^,FY). 

Theorem  3.1,   LetF  be  a  belt  with  identity  and  null  element.    Then  for  all  non-empty 
finite  coordinate  setsX.,  Y,  [F^f'  is  isomorphic  to  Homp(F-^,F'^). 

Corollary  3.2.    Let  F  be  a  belt,  and  let  X  9^0  be  a  finite  coordinate  set  with  |x|  >  1. 
Then  a  necessary  and  sufficient  condition  that  (F-^)^  be  isomorphic  to  Homjr(  F -^ ,  F  ^' ),  for 
all  non-empty  finite  coordinate  sets  Y,  is  that  F  have  an  identity  element  (f>  with  respect  to 
X  and  a  null  element  9  with  respect  to  V. 

We  call  a  template  t  £  (F"^)^  used  with  the  operation  V,  El ,  0  ,  ® ,  or  ®  a  lattice 
transform.   We  will  present  an  example  of  a  transformation  which  is  not  right  linear  in  sec- 
tion 6.1. 
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3.1.3.    Tnpqiialifjps 

Some  useful  inequalities  are  stated  in  the  next  liicoreni. 

Theorem  3.3.    Let  F  be  a  subbelt  ofR_^^,^  or  R^^.    Then  the  following  inequalities  hold  for 
images  and  templates  with  the  appropriate  domains,  having  values  in  F. 

(i)  aV(bAc)<(aVb)A(aVc) 

(ii)  aA(b  Vc)>(aAb)  V(aAc) 

(iii)  (a  Ab)  M  t  <(a  M  t)  A(b  M  t)  (a  A  b)  ®  t  <  (a  ©  t)  A  (b  ©  t) 

(iv)  a  M  (t  As)  <(a  M  t)  A(a  M  s)  a  ©  (t  A  s)  <  (a  ©  t)  A  (a  ©  s) 

(v)  (aVb)  Q  t  >(a  0  t)  V(b  Q  t)  (a  V  b )  ®  t  >  (a  ®  t)  V  (b  ®  t) 

(vi)  a  Q  (t  Vs)  >(a  0  t)  V(a  Q  s)  a  ®  (t  V  s)  >  (a  ®  t)  V  (a  ®  s) 


8  V(t  Ar)<(s  Vt)  A(s  Vr) 

8  A(t  Vr)>(s  At)  V(s  Ar) 

tM  (8Ar)<(tMs)A(tM  r)  t©(sAr)<(t©8)A{t©r) 

(8Ar)l2l  t<(8|21  t)A(rE|  t)  (8Ar)®t<(s©t)A(r©t) 

tQ  (sVr)>(tEI  8)V(t|Z3  r)  t®(8\/r)>(t®8)V(t®r) 

(sVr)EI  t>(s[Z3  t)V(rEl  t)  (sVr)®t>(s®t)V(r®t) 


and 


aM  (80  r)<(aM  s)0  r  and  aQ(sElr)>(a|Z3s)iar 
tM(s|Z3r)<(tMs)0r  and  t0(s|21r)>(tQs)Mr 

a©(8®r)<(a©s)®r  and  a®(s©r)>(a®s)®r. 
t©(8®r)<(t©s)®r  and  t®(8©r)>(t®8)©r. 


51 


We  remark  that  the  above  properties  corresponding  to  the  forward  multiplications  of 
an  image  by  a  template  as  defined  in  Chapter  1  are  also  valid,  namely, 
tM  (aAb)<(tI21  a)A(tE|  b),  etc. 

3.1.4 Conjiigacy 

The  notion  of  conjugacy  as  discussed  in  section  1.2  extends  to  templates  as  well.   Sup- 
pose that  F  and  F*  are  conjugate.   Then  for  t  G  (F^')"^',  t*  G  ((F*)"^)^  is  defined  by 

Kiy)  =  {ty(xyf. 

The  conjugate  of  t  €  (R^)^  is  the  additive  dual  t*,  and  the  conjugate  of 
t  G  ((R^^)^)^  is  the  multiplicative  dual  t,  both  of  which  are  defined  in  section  1.1. 

Let  P  be  any  set  of  F  valued  templates  from  Y  to  X,  with  F  and  F*  as  conjugate  sys- 
tems.  Define  P    by 

P*   =  {t*:tGP}. 
Here,  the  star  symbol  *  denotes  the  dual  template  for  either  value  set  R^^^or  R^^.   Note 
thatP*C((F*)^'f.   We  have 

Theorem  3.4.  Let{F,\/)  and{F*,A)  be  conjugate.    TAen  ((F^)^,  V,  M  )  and 
(((F  )    )"  ,A,  0)  are  conjugate,  where  F  is  a  sub-bounded  l-group  ofR,^^  and 
{{F^)^ ,\/,Q))  and{{{F  )^  )'^,A,®)  are  conjugate,  where  F  is  a  sub-bounded  l-group  of 
■^±Lo'  Z*""  ^"2/  non-emptxj  finite  coordinate  sets  X,  Y.    In  all  cases  the  conjugate  of  a  given 
template  t  is  the  dual  template  t    or  t  of  the  respective  bounded  l-group  as  defined  in 
Chapter  1. 

Proposition  3.5.  //(F,V,X  .A.X*)  is  a  self-conjugate  belt,  then  {{F*  f^f''  =(F^')^/or  all 
non-empty  finite  coordinate  sets  X,  Y.  Also,  ((R^,)'^,\/,EI  ,A,IZ3  )  is  a  self-conjugate  belt, 
and  {{{R^^f-)^,\/,Q) ,/\,®  J  is  a  self-conjugate  belt. 
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An  pyamplp  In  this  section  we  give  an  application  to  a  scheduling  problem,  showing  the 
use  of  the  conjugate  of  a  template.  In  particular,  this  example  provides  a  physical  interpreta- 
tion of  the  conjugate  of  a  template. 

Suppose  we  have  n  tasks,  or  activities,  or  subroutines,  labelled  l,...,n.   Let  a(x-^)  denote 
the  starting  time  of  task  i,  and  assume  without  loss  of  generality  that  task  1  is  the  starting 
activity,  task  n  is  the  finishing  activity,  and  that  tasks  2  through  n-1  are  intermediate  activi- 
ties.  Suppose  we  are  given  the  time  of  the  starting  activity,  and  we  wish  to  know  the 
soonest  time  at  which  each  subsequent  activity  can  be  started.   In  particular,  what  is  the  ear- 
liest time  that  task  n  can  start,  or,  what  is  the  earliest  expected  time  of  completion  of  the 
collection  of  tasks? 

The  relation  of  the  tasks  to  one  another  can  be  described  by  a  partial  order  R,  on  the 
set  of  tasks  {l,...,n}: 

j  ;?  i  if  and  only  if  task  j  is  to  be  completed  before  task  i  can  start. 

Let  djj  denote  the  minimum  amount  of  time  by  which  the  start  of  activity  j  must  pre- 
cede the  start  of  activity  i.  That  is,  d|j  is  the  the  duration  time  of  activity  j,  or  the  process- 
ing time  of  task  j,  which  must  pass  before  activity  i  can  start.   Define  w  E  (Ri^)''^  by 

■^r  y  [—oo       otherwise 

There  is  an  obvious  relationship  between  the  weighted  digraph  associated  with  the  partial 
order  relation    R.  and  the  template  w.   For  example,  suppose  we  have  5  tasks  or  activities,  or 
subroutines  of  a  program,  which  have  the  following  relation  or  partial  order: 
(1,2)   (1,3)   (2,4)   (2,5)   (3,-1)   (3,5)  (4,5) 

Here,  activity  1  is  the  start  activity,  activity  5  is  the  end  activity,  and  tasks  2,3,4  are  inter- 
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mediate  tasks  or  subroutines.   Suppose  the  duration  times  djj  of  the  activities  are: 

doi  =1       d3i  =  6       d^o  —  - 

^43  =  1       djo  =  1       d53  =  3       ds^  =  3 
and  djj  =0  for  each  i  =  1,...,5.   This  is  consistent  with  a  meaningful  physical  interpretation  of 
the  definition  of  duration  time  for  a  task. 

The  corresponding  weighted  digraph  is  given  in  Figure  6. 


Figure  6.   A  Scheduling  Network. 


The  nodes  represent  the  activities,  and  the  duration  times  are  given  as  numbers  on  the 
directed  edges  linking  the  nodes. 

In  determining  a(x^)  for  example,  note  that  a(x^)  must  satisfy 

a(xj   =   maxtd,,.,  +  a(xo) ,  d,,3  +  a(x3) ,  d^^  +  a(xj  } 
or  equivalently 

a(x.j)    =    max  {w   (Xj) +a(xj)}, 

1<J<.5 

This  last  equality  follows  from  the  fact  that  w^.  (xj)  =  —oo  if  j  is  not  related  to  i.   In  the  gen- 
eral setting,  we  must  solve,  for  each  i  ==  l,...,n: 
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a(xi)  =   max  {w  (Xj)  +a(xj)} 

l<j<n  ' 

or,  writing  the  problem  as  an  image  algebra  expression,  we  must  solve  for  a  in 

a  C3  w    =  a.  (3-1) 

Here,  a  is  an  image  on  X  where  |X|  =  n. 

An  analysis  of  a  network  in  this  manner  is  called  backward  recursion  analysts. 

Under  forward  recursion,  suppose  we  have  n  tasks  with  duration  times  fj:,  where  fjj  is 
the  minimum  amount  of  time  by  which  the  start  of  activity  i  must  precede  the  start  of 
activity  j,  if  the  activities  are  so  related.   Otherwise,  let  fy  have  value  — oo.   Define 

,  ,      I  fij    ifj;2i 

Wv(Xi      =1  .1  •      . 

*p  i'  [—oc       otherwise 

As  before,  fji  =  0  gives  a  consistent  physical  interpretation. 

Let  T  be  the  planned  completion  date  of  the  project,  which  is  given,  and  define  a(xi)  to 
be  the  latest  allowable  starting  time  for  activity  i.   We  wish  to  determine  a(x^),...,a(Xn_j) 
such  that  a(x„)  =  t.   Thus,  we  desire  to  solve  for  a  in 

a(Xi)   =     min  ( - w  (xj)  +  a(xj) ) 

j=l,...,n  ' 

for  i  =  l,...,n.   For  example,  for  5  nodes,  suppose  we  have  the  following  relations: 

(1,2)   (1,3)   (2,4)   (2,5)   (3,1)   (3,5)  (4,5)  . 

Here  we  write  (i,j)  if  task  i  must  precede  task  j.   Suppose  the  times  f-  of  the  activities  are: 

f,,  =  l       fi3  =  6       fo,=2 
i^4-l        fo,  =  l        135=3       f,5  =  3 
Suppose  we  would  like  to  find  a(x4),  say,  satisfying 
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a(xj    =     mill  (-W   (Xj) +a(xj)). 
j=l,...,5  ^ 

The  value  — w^  (xg)  +  a(x5)  is  the  hitest  allowable  time  to  start  task  5  minus  the  minimum 
amount  of  time  activity  4  must  precede  activity  5,  and  the  time  to  start  task  4  must  be  at 
least  as  small  as  this  number.   Thus,  the  time  to  start  task  5  must  be  at  least  as  small  as  -1 
+  a(x5).   The  value  a^x^)  =  min  {  — w^  (x^)  +  afxj)  }  =  -1  +  t.   (All  other  values 
— W3(^{Xj)  +  a(xj)  =  +00  as  — w^  (xj)  =  -j-oc  for  j  9^  5.)   Since  r  is  given,  this  quantity  can  be 
explicitly  determined.   The  remaining  equations  can  be  solved  similarly. 
If  we  define  u  G(R^J^'by 

U„    X;        =  ,  ,,  . 

"1^  i'  K         +00       otherwise 

then  it  is  obvious  that  in  general  we  must  solve  for  a  the  following: 

a  Q  u    =  a.  (3-2) 

It  is  clear  that  the  template  u  in  equation  (3-2)  is  the  conjugate  of  the  template  w  in  Equa- 
tion (3-1).   That  is, 

u    =  w  . 
We  can  say  that  the  templates  w  and  w*  define  the  structure  of  the  network  as  we  analyze  it 
backward  or  forward  in  time,  respectively. 

3.1 .5.    Alternating  tt,*  and  tt  Products 

This  section  discusses  the  concept  of  an  alternating  tt   or  tt  product  of  a  template  t 
and  its  conjugate  under  the  operation  M  or  ® ,  respectively.    We  shall  state  the  results  only 
for  the  sub-bounded  1-groups  of  R_^^  and  the  operations  M  and  IZ3  ,  with  the  understanding 
that  unless  otherwise  stated,  an  arbitrary  sub-bounded  1-group  of  R^^  and  the  operations  © 
and  ®  may  be  substituted  in  the  appropriate  places. 
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Theorem  3.6.  LetF^^  be  a  sub-bounded  l-groiip  ofR^^,  where  F  denotes  the  group  of 
the  bounded  l-group  F_^.^,  andt  G  (F^J^.    Then  we  have 

tM(t*IZ3t)   =t|Z3(t'Mt)=(tlZ3t*)l21t   =(t|2lt*)IZ3t=t. 
Similarly, 

t*  M  (t  [Z3  t*)  =t'  IZ3(t  M  t*)  =(t*  0  t)  M  t*  =(t*  M  t)  Q  t*  =t*. 

We  now  define  an  alternating  tt   product.    Write  a  word  consisting  of  the  letters  t  and 
t  ,  in  an  alternating  sequence.   A  single  letter  t  or  t   is  allowed.   If  we  have  k  >  1  letters, 
now  insert  k-1  symbols  of  M  and  23  ,  in  an  alternating  manner.   For  example,  the  following 
sequences  are  allowed: 

t*  Q  t 
t  Q  t*  M  t 
t*  M  t  IZ3  t*  M  t  El  t*  M  t. 
Now  insert  brackets  in  an  arbitrary  way  so  that  the  resulting  expression  is  not  ambiguous. 
For  example, 

t*  EI  t 

t  El  (t'  M  t) 

(t*  M  ((t  El  t')  M  t))  El  (t*  M  t). 

Any  algebraic  expression  so  constructed  is  called  an  alternating  tt'  product. 

Suppose  an  alternating  tt    product  an  odd  number  of  letters  t  and/or  t*.    Then  we  say 
it  is  of  type  t  if  it  begins  and  ends  with  an  t,  and  that  it  is  of  type  t*  if  it  begins  and  ends 
with  an  t  .   If  it  has  an  even  number  of  letters  we  say  that  it  is  of  type 

t  El  t*  or  t  El  t*  or  t*  0  t 

exactly  according  to  the  first  two  letters  with  its  separating  operator,  regardless  of  how  the 
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brackets  lie  in  the  entire  expression.  As  an  example: 

t    IZ3  t  is  of  type       t*  Q  t 

t  0  ( t'  M  t )  is  of  type  t 

(t*  M  ((t  IZ3  t*)  M  t))  0  (t*  M  t)       is  of  type       t*  M  t. 

Theorem  3.7.    Let  F^^  be  a  sub-bounded  l-group  ofH^^  and  t  an  arbitrary  template  in 
(F_^og)    .    Then  every  alternating  tt   product  P  is  well-defined,  and  ifP  is  of  type  Q,  thenF 

=  Q- 

If  a  product  P  has  more  than  1  letter,  then  we  define  P(z)  to  be  the  formal  product 
obtained  when  the  last  (rightmost)  letter,  t  or  t  (or  t),  is  replaced  by  z,  where  z  is  a  F 
valued  template  on  the  appropriate  coordinate  sets  X  and  Y. 

Theorem  3.8.   LetF^^  be  a  sub-bounded  l-group  ofH^^  and  t,  z  arbitrary  templates 
overF.    IfP  is  an  alternating  tt   product  containing  four  letters  andP  is  of  type  Q,  then 

P(z)   =  Q(z). 

3.2.    Systems  of  Eqnntions 
We  now  discuss  the  problem  of  finding  solutions  to  the  problem: 

Given  t  G  ( R^J^'  and  b  6  R2^,  find  a  E  R^^  such  that  a  M  t  =  b .  (3-3) 

Similarly,  we  also  wish  to  solve: 

Given  t  G  ((R+^)^')'*'  and  b  G  (R+^)^',  find  a  G  (R^,)^  such  that  a  ©  t  =  b . 
Here,  Ixl  =m,  |y|  =n. 
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3.2.1.    F-a.stirit,y  and  /-solutions 

If  F  is  a  bounded  1-group  and  x,  y  €  F,  we  say  that  the  products  x  X  y  and  x  x'  y  are 
/-undefined  if  one  of  x,y  is  —oq  and  the  other  is  -f  oo.   We  say  that  a  template  product  is  /- 
undefined  if  the  evaluation  of  ty(x)  reciuires  the  formation  of  a  /-undefined  product  of  ele- 
ments of  the  bounded  1-group  F^^o-   Otherwise,  we  say  that  a  template  product  is  /-defined 
or  /-exists.   Some  mathematical  models  require  solutions  which  avoid  the  formation  of  /- 
undefined  products,  as  in  practical  cases  these  often  correspond  to  unrelated  activities.   We 
state  these  results  for  both  bounded  1-groups  where  appropriate,  with  the  ®  results  in 
parentheses.   As  usual,  the  sul>bounded  1-group  F^j^  is  dependent  on  which  operation,  M  or 
®  is  used. 

Lemma  3.9.    Let  Y^^  be  a  subbelt  o/R^^  (R-±J-    Let  X  and  Y  be  non-empty,  finite 
arrays,  and  t  G  (F^)"^.    Then  the  set  of  all  images  a  G  F^^^  such  that  a  M  t  (a  ®  t)  is 
/-defined  is  a  sub-s-lattice  o/F^.    He7ice  the  set  of  solutions  a  of  statement  (3-3)  such  that 
a  M  t  (a  ®  t)  /-exists  is  either  empty  or  is  a  sub-s-lattice  ofF^. 

Lemma  3.10.  Let  X,  Y,  aiid  W  be  non-empty,  finite  arrays,  and  t  G  (F^^)^'.  Then  the 
set  of  templates  a  G  (F^)^,  such  that  s  M  t  (s  ®  t^  is  /-defined  is  a  sub-s-lattice  of 

(Fii,)^. 

Any  solution  a  of  statement  (3-3)  such  that  a  M  t  (a  ®  t)  /-exists  is  called  a  /-solution 
of  (3-3). 

Theorem  3.11.  Let  F^^o  ''^  «  sub-bounded  t-group  ofR^^  (R^cJ-  Then  (3-3)  has  at  least 
one  solution  if  and  only  «/a  =  b  Q  t  {a,  =  h  ®  t)  is  a  solution.  In  this  case,  a  =  b  0  t* 
(a  =  b  ®  t)  is  the  greatest  solution. 
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Recall  from  probability  theory  that  a  row-stochastic  matrix  is  a  non-negative  matrix  in 
which  the  sum  of  the  elements  in  each  row  is  equal  to  1.  We  will  make  analogous  definitions, 
where  the  operation  -I-  is  replaced  by  the  operation  V,  and  the  unity  element  is  — oo. 

Let  P  C  F^ooi  where  F^^  is  an  arbitrary  sub-bounded  1-group  of  R_^^  (R^oo)-   -^  tem- 
plate t  G  (F^)^  is  called  row-P-astic  if  V  tv.(xj)  €  P  for  all  i  =  l,...,n  and  column-V-astic  if 


V  ^'x{V\)  G  P  for  all  j  =  l,...,m.   The  template  t  is  called  doubty-P-astic  if  t  is  both  row-  and 
i=i     J 

column- P-astic.   Note  that  if  t  is  column-P-astic,  then  t'  is  row-P-astic, 

Theorem  3.12.   Let  F^^  be  a  sub-bounded  l-group  o/R^^,  (R+J  and  t  G  (F^)\  b 

G  F^j^  such  that  (3-3)  is  soluble.    Then  a  =  b|Z3t    (a  =  b®t)  /-exists  arid  is  a  /-solution 

o/(3-3),  if  and  only  if  one  of  the  following  cases  is  satisfied: 

(i)       t  G  (F"  )     ,  and  b  =  -{-oo,  the  constant  image  with  +CX3  everywhere, 
(ii)      t  G(F^)^,  andb  =-oo. 
(iii)       t  G  (F^J^'  is  doubly  F-astic,  and  b  G  F-^. 

Moreover,  every  solution  o/(3-3)  is  then  a  /-solution,  aridh  Q  t   (b  ®  t)  is  equal  to  -foo, 
—  oo,  or  is  finite,  respectively  according  as  case  (i),  (ii),  or  (iii)  holds. 

In  the  following  theorem,  we  state  the  dual  and  left-right  generalizations  of  Theorems 
3.11  and  3.12. 

Corollary  3.13.    LetF^^  be  a  sub-bounded  l-group  o/R^^(R^^,  and  let 
t  G  (F^oq)     ,  b  G  F^^.    Then  for  all  combinations  of  c,q,  and  6  given  in  Table  1,  the  follow- 
ing statement  is  true: 

The  image  algebra  equation  c  has  at  least  one  solution  if  and  only  if  the  product  d  is 
a  solution;  and  the  product  d  is  then  the  6  solution.    Furthermore,  if  the  product  d 
is  /-defined,  and  equation  c  is  /-defined  when  a  =  d,  then  equation  c  is  /-defined 
when  a  is  any  solution  of  equation  c.    IfF^^  is  a  sub-bounded  l-group  ofH^^  then 
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the  results  in  Table  1  hold  for  Q)  replacing  M   everywhere  and  t  replacing  t    every- 
where. 

Table  1. 


c 

d 

6 

a  M  t  =b 

b  0  t* 

greatest 

a  M  t    =  b 

b  0  t 

greatest 

a  0  t  =b 

b  EZI  t* 

least 

a  Q  t*  =  b 

b  M  t 

least 

t  M  a  =  b 

t*  0  b 

greatest 

t*  M  a  =  b 

t  Q  b 

greatest 

t  E3  a  =  b 

t*  M  b 

least 

t*  23  a  =  b 

t  M  b 

least 

If  d  is  a  solution  to  c  in  Table  1,  then  d  is  called  a  principal  solution. 

We  can  also  restate  the  last  three  theorems  as  a  solubility  criterion. 

Problem  (3-3)  is  soluble  if  and  only  if(b  Q  t*)Ea  t=b[(b®t)®t)=b];  and  every 
solution  is  a  /-solution  if(b  Q  t  )M  t[(b®t)®t)=b]  /-exists. 

Note  that  Theorem  3.12  identifies  the  cases  in  which  (3-3)  has  a  /-defined  /-solution. 
All  solutions  are  then  /-solutions.   The  next  question  to  ask  is:   can  we  find  all  solutions?   We 
now  focus  on  the  following  problem. 
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Given  that  F  is  R^^  (R+J  and  that  (b  0  t*)  M  t)  [(b  ©  t)  ®  t)]  (3-4) 

/-exists  and  equals  b,  find  all  solutions  of  (3-3). 


For  cases  (i)  and  (ii)  of  Theorem  3.12,  we  note  that  t  is  finite.   The  next  proposition 
gives  solutions  for  these  two  cases. 

Proposition  3.14.    LetF^^^  be  a  sub-bounded  l-group  o/R^^(R^^.    Ifh  =  — oo  (the  con- 
stant image),  then  Problem  (3-4)  has  b  as  its  unique  solution.    Ifh  =  +oo,  theji  Problem  (3- 
4)  has  as  its  solutions  exactly  those  images  ofF^^  which  have  at  least  one  pixel  value  equal 
to  -l-oo. 

To  determine  solutions  to  case  (iii),  we  need  to  consider  the  particular  case  that  F^^  is 
the  3-element  bounded  l-group  Fg.   Here  b  is  finite  with  all  elements  having  value  (j). 

Lemma  3.15.   Let  F^^  be  the  3-element  bounded  l-group  F3.    Let  t  be  doubly  F-astic  and 
b  be  finite.    Then  (3-3)  is  soluble,  having  as  principal  /-solution  a  =  1  where  l(x)  =  (j)  for  all 
i.   Hence,  no  solution  to  (3-3)  contains  -\-oo  for  any  pixel  value,  and  all  solutions  are  /- 
solutions. 

3.2  2     All  Solutions  tn  a.  M   t  =  b  and  a.  O  t,  =  h 

We  now  give  some  criterions  for  finding  all  solutions  to  problem  (3-3)  for  the  case  where 
the  template  t  is  doubly  F-astic  and  b  finite.   We  discuss  the  general  case  where  F  is  the 
belt  R  or  R+. 

If  a  template  t  G  (F^)-^  has  form 
we  write  t  =  diag(Qi,  Q.i,  .  .  .  ,  Q'„J. 
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For  b  G  F  finite,  define  the  template  d  €  (F^J-"^  by  d  = 

diag([b(xjr,  [b(x,)]*,...,[b(xjn. 

Since  b  is  finite,  so  is  d3^(xi),  and  d^(xj)  =  — b(x|)  (or  l/b(xj))  V  i  =  l,...,m.   Thus,  solving 
(3-3)  is  equivalent  to  solving 

a  M  s  =  1 ,  (3-5) 

or 

a  ®  s  =1, 
where  s=d  M  t(s=d®t)G  (F^)^,  and  1  =  (f>,  the  constant  image.    Note  that 
«yj^j)  =  *n.(^j)  -  ^('^j)  (SyJ^j)  =  <^yjxj)  *  lA>(xj)  )■    Now,  for  each  image  s\^  G  F^^,  let  W'j 
=  {(xj  ,yi )  :  syyj)  =  ^  a'^  (yj  }.   Note  that  W'j  C  X  X  Y  for  every  j.   The  elements  s'^  (y;) 
corresponding  to  (xj  ,y| )  G  W'j  are  called  marked  values  of  W'j.   Notice  that  every  image  s'^. 
will  have  at  least  one  marked  value,  as  d,  t  and  s  are  doubly  F-astic.   Our  next  theorem 
gives  conditions  where  there  is  no  solution. 

Lemma  3.16.    Let  F^^  be  a  bounded  l-group,  t  G  (Fi^)^  where  t  is  doubly  F-astic,  and 
h  GF^.   Defi7ie  s  e  {F^J^^  by 

s=d|21t(or    s=d©t) 
depending  on  whether  the  group  F  is  R  or  R"*",  respectively,  and  d  is  as  above.    Suppose 
there  eiists  i  such  that  for  no  j  is  s  (xj)  a  marked  value.    That  is,  suppose  there  exists 
yj  G  Y  such  that  s  (Xj)  is  not  a  marked  value  for  any  j.    Then  there  does  not  exist  a  G  F^ 
such  that  aM  t=b(a®t=b). 

There  now  remains  the  case  in  which  for  every  i,  there  is  at  least  one  j  such  that  Sy.(xj) 
is  a  marked  value.   We  transform  the  question  into  a  boolean  problem,  where  it  can  be 
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shown  that  the  following  procedure  will  give  a  set  of  solutions  to  equation  (3-5)  [38]. 
Step  1.   For  the  bounded  1-group  F^.^^  =  F3,  define  g  G  (F^)^  by 

I       0        'f  s'^/yi)  is  marked 
S.V|lXjj    —    y     _^^      otherwise 

Letting  f  E  F^^,  now  solve  the  boolean  system 

J 
fMg=l     (or      f®g  =  <i).  (3-6) 

As  in  the  case  for  matrices  [38],  each  solution  to  equation  (3-6)  consists  of  an  assignment  of 

one  of  the  values  —00  or  <f>  to  each  f(xj). 

Let  f  =  (f(xj),...,f(Xjj|))  be  a  solution  to  equation  (3-6). 

Step  2.   For  each  j  =  l,...,m:  if  f(xj)  =  (f)  then  set  a(xj)  to  be  the  value  —  fVs'.^.  ] 

(l/(  Vs'      p.   If  f(xj)  =  —00  then  a(xj)  is  given  an  arbitrary  value  such  that  a(Xj)  < 

-(VS'.3)(1/((VS',J. 

For  the  boolean  case,  we  have 

Proposition  3.17.  The  solutions  of  equation  (3-6)  are  exactly  the  assignments  of  the  values 
<j)  or  —00  to  the  variables  f(xj)  such  that  for  every  i  =  l,...,rn  there  holds  f(xj)  =  <j)  for  at  least 
one  j  such  that  s^.  (x;)  is  a  marked  value. 

Theorem  3.18.   Let  F^^  be  a  bounded  l-group.    Then  the  above  two  step  procedure  yields 
all  solutions  to  equation  (3-7)  without  repetition. 

3. '2. 3.    Existence  and  Uniqueness 

This  section  discusses  some  existence  and  uniqueness  theorems  concerning  solutions  to 
Problem  (3-3). 
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Theorem  3.19.    LetF^^  be  a  bounded  l-group,  and  let  t  G  (Fi^)^  be  doubly  F-astic  and 
b  E  F     be  finite.    Then  a  necessary  and  sufficient  condition  that  the  equation  a  M  t  =  b 
(a  ®  t  =  b)  shall  have  at  least  one  solution  is  that  for  allx^  6  X,  there  exists  at  least  one  j 
such  that  for  the  template  s  =  d  M  t  (s  =  d  ®  t),  where  d  is  as  defined  as  above, 

Sy  (xj)  is  a  marked  value  . 
We  remark  that  the  solution  a(xj)  =  —  Vs'^.l  (l/(  Vs'^    [))  gives  exactly  the  principal 

solution. 

This  is  equivalent  to 
Theorem  3.20.    Let  F^^  be  a  bounded  l-group,  let  t  €  (Fi^)^  be  doubly  F-astic,  and  let 
b  G  F     be  finite.    Then  a  necessary  and  sufficient  condition  that  the  equation  a  M  t  =  b 
(a  ®  t  =  b)  shall  have  exactly  one  solution  is  that  for  aZ/xj  G  X,  there  exists  at  least  one  j 
such  that 

8y(x:)  is  a  marked  value, 
and  for  each  j  =  l,...,n,  there  exists  an  i,  1  <  i  <  m  such  that  I  \V\\  =  1. 

Define  a  template  t  G  (F^^)     to  be  strictly  doubly  (jyastic  if  it  satisfies  the  following 
two  conditions. 

(i)      t^.{x)<^,\,i=l,...,n 
(ii)       for  each  i  =  l,.-,n,  there  exists  a  unique  index  j  G  {l,2,...,n}  such  that  t  (x:)  has  value  (f. 

If  t  G  ( F^)    ,  I  X|  =  m,  I  YI  =  n,  then  we  say  that  t  contains  a  template 
s  G  (F^o^)    '  if  the  matrix  ^    (t)  contains  the  matrix  ^    (s)  of  size  h  x  k,  where  I  Wol  =  h, 
I  Wj  =  k,  and  both  h,k  <  min(m,n).   We  say  that  a  template  t  G  (F^^^)     contains  an  image 
a  G  F^"^  if  a  =  ty  for  some  y  G  Y. 
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Theorem  3.21.  Let  F^^  be  a  bounded  l-group,  lei  t  G  (F^)^  be  doubly  F-astic,  and  let 
b  G  F     be  finite.    Then  a  necessary  and  sufficient  condition  that  the  equation  a  M  t  =  b 
(a  ©  t  =  b)  shall  have  exactly  one  solution  is  that  we  can  find  k  finite  elements  a^,  .  .  .  ,a^ 
such  that  the  template  d  defined  by 

dy,(xj)    =   -b(yi)  +  yxj)  +  O'j      (  or  d,.  (xj)    =  b(yi)-i  *   t^/xj)  *  a-^ 
is  doubly  <f>-astic  and  that  d  contains  a  strictly  doubly  ({>-astic  template  sG(F^^)^',  I  W|  =k. 

3.2.4.    A  Linear  Programming  Critprion 

Since  one  of  our  interests  is  the  case  where  the  bounded  l-group  is  the  R^oc»  we  now 
show  that  the  problem  can  be  stated  as  a  linear  programming  problem  for  this  bounded  1- 
group. 

Theorem  3.22.  Let  t  G  (R^J^  be  doubly  F-astic  and  b  G  F^^'  be  finite.  Let  I  be  the  set 
of  index  pairs  (i,j)  such  that  ty  (Xj)  is  finite,  1  <  i  <  n,  1  <  j  <  m.  Then  a  sufficient  condi- 
tion that  the  equation  a  M  t  =h  be  soluble  is  that  some  solution  {  ^^j  |  (i,j)  G  I  }  o/  the  fol- 
lowing optimization  problem  in  the  variables  Zy  for  (i,j)  G  I: 

Minimize  S    ( b(yi)  -  t  (Xj))  ly 

(i,j)ei  "   ' 


Subject  to 


and 


.(i,j)ei    ) 


=   1,  j  =  l,...,m 


Zi:>0,(i,j)GI 


shall  also  satisfy: 


>    0,  i  =  l,...,n. 


We  now  make  a  definition  which  will  be  used  in  the  next  section.   Let  F^^^  be  a  belt, 
and  let  t  G  (F^)     be  arbitrary.   The  right  column  space  oft  is  the  set  of  all  b  G  F^  for 
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which  the  equation 

aElt=b     (or      a®t=b) 
is  soluble  for  a. 

3.2.5.  Linear  DepfiKJencc 

Linear  Hependenre  over  n  hoiinHofl  1-gronp.  VV^e  can  consider  the  equation  a  M  t  =  b 
(or  a  ©  t  =  b)  in  another  way.   For  the  images  t'^  ,  rewrite  a  M  t  =  b  as 

,fjt',^M  a(xj)]=b,  (3-7) 

where  a(xj)  G  (F^oo)^  is  the  one-point  template  with  target  pixel  value  of  a(Xj).   In  this  case, 
we  say  that  b  is  a  linear  combination  of  {t'^  ,t'^,  ■  ■  ■  ,t'^   },  or,  that  b  G  F^  is  (right) 
linearly  dependent  on  the  set  {t'^^  ,1'^^  ,  .  .  .  ,t',^   }.    We  can  make  analogous  definitions  for  the 
case  of  ® .   While  in  linear  algebra  the  concept  of  linear  dependence  provides  a  foundation 
for  a  theory  of  rank  and  dimension,  the  situation  in  the  minimax  algebra  is  more  compli- 
cated.  The  notion  of  strong  linear  independence  is  introduced  to  give  us  a  similar  construct. 
Theorem  3.23.   Let  F^^^  be  a  bounded  l-group  other  than  F3.    Let  X  6e  a  coordinate  set 
such  thatl'Kl  >  2,  and  k  >  1  6e  an  arbitrary  integer.    Then  we  can  always  find  k  finite 
images  on  X,  no  one  of  which  is  linearly  dependent  on  the  others. 

If  F^^  =  F3,  then  we  can  produce  a  dimensional  anomaly. 

Theorem  3.24.    Suppose  F^^  =  F3,  and  let  X  be  a  coordinate  set  such  that  Ixl    =  m  > 
2.    Then  we  can  always  find  at  least  (m"  -  m)  images  on  X,  no  one  of  which  is  linearly 
dependent  on  the  others. 

Since  every  bounded  l-group  contains  a  copy  of  F3,  the  dimensional  anomaly  in 
Theorem  3.24  extends  to  any  arbitrary  bounded  l-group. 
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Let  1x1  =  in,  I  Y|  =  n,  and  t  G  (F'^)"^  wlierc  F  is  an  arbitrary  bounded  1-group.   We 
would  like  to  define  the  rank  of  t  in  terms  of  linear  independence,  and  to  be  equal  to  the 
number  of  linearly  independent  images  t'^  of  t.   Suppose  we  were  to  define  linear  indepen- 
dence as  the  negation  of  linear  dependence,  that  is,  a  set  of  k  images  on  X  (aj,  .  .  .  ,a.^^)  is 
linear  independent  if  and  only  if  no  one  of  the  a;  is  linearly  dependent  on  any  subset  of  the 
others.   Then  applying  Theorem  3.23  for  |X|  =  n  and  k  >  n,  we  could  find  k  finite  images 
which  are  linearly  independent.   If  we  defined  rank  as  the  number  of  linearly  independent 
images  ty  of  t,  then  every  template  would  have  rank  k  >  n,  which  is  not  a  useful  definition 
in  this  context. 

Strong  linear  inHppendence.  As  for  the  matrix  algebra,  we  define  the  concept  of  strong 
linear  independence  [38]. 

Let  F^^  be  a  bounded  1-group  and  let  a(l),...,a(k)  G  F^,  k  >  L   We  say  that  the  set 
{a(l ),..., a(k)}  is  strongly  linearly  independent,  or  simply  SLL  if  there  is  at  least  one  finite 
image  b  G  F'   which  has  a  uniciue  expression  of  the  form 


b  =  V^a(jp)  M  Xj^     (or     b  =  V^a(j^)  ®  \)  (3-8) 

with  Xj^  G  F,  p  =  l,...,h,  1  <jp  <k,  p  =  l,...,h,  and  jp  <  j.^  if  p  <  q. 

If  A  =  {ai.a.2,  .  .  .  ,a|^ }  is  a  set  of  k  images  where  each  a^  G  F2oo7  I  Y|  =  n,  then  we 
define  the  template  based  on  the  set   A  in  the  following  way.    For  the  integer  k,  we  find  a 
coordinate  set  W  which  has  k  pixel  locations,  that  is,  I  W|  =  k.   To  this  end,  choose  a  posi- 
tive integer  p  such  that  k  =  pq  4-  r,  where  r  <  p  (by  the  division  algorithm  for  integers). 
Let  W  denote  the  set  {(i,j)  :  0  <  i  <  p-1,  0  <  j  <  q-1  }  U  {(-1  J)  :  0  <  j  <  r-1  },  which  is 
a  subset  of  Z"  that  is  almost  rectangular.   There  is  an  additional  row  in  the  fourth  quadrant 
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corresponding  to  the  r  left-over  pixel  locations  that  don't  c(uite  make  a  full  row.   Of  course, 

there  are  other  selections  that  can  be  made  for  W.   Define  the  template  t  based  on  A  by 

te{F2I)^',  where 

t',,    =  ai,i  =  l,...,k. 

To  clarify  notation,  we  will  denote  the  template  based  on  the  set   A  =  {3,^,3^,  .  .  .  ,a,^^)  by  t 
=-B{A).   Hence,  if  t  S  (F^^)^',  then  for   A  -{t'^^.t'^^,  .  .  .  ,t'^^},  we  have  B(^)  =t.   If   P  = 
{aj,a.2,  .  .  .  ,aij }  is  a  set  of  h  F  valued  images  on  X,  we  denote  the  right  column  space  of 
B{P)  by  <  ai,a.2,  .  .  .  ,ah  >.   Thus,  for  t  G  (F^)\  <  t'^  ,t'^^,...,t'^^>  is  the  right  column 
space  oft.   The  set  <  a^.a.,,  .  .  .  ,aj,  >  is  also  called  the  space  generated  by  the  set 
1^1)^^?  .  .  ,  ,  aj^  J. 

Lemma  3.25.   Let  F^^  be  a  bounded  l-group  with  group  F.    Let  c^,  .  .  .  ,c^^,h  E  F^,  k  > 
1  be  such  that  b  is  finite  and  has  a  unique  expression  of  the  form  (3-8).    Then  h  =  k;  j^  = 
1,...,  Jh  =  k;  Xj   E  F,  p  =  l,...,h;  and  t  is  doubly  F-astic,  where  t  G  (F^)^'  is  the  template 
based  on  the  set  C  =  {cj,  .  .  .  ,c^^}.    Here,  I  Y|  =  k. 
We  also  have 

Corollary  3.26.    LetF^^  be  a  bounded  l-group  and  let  Cj,  .  .  .  ,c^  G  F^for  an  integer  n 
>  1.    Then  {cj,  .  .  .  ,c„}  «s  SLI  if  and  only  if  there  exists  a  finite  image  b  G  F     such  that 
the  equation  a  M  t  =  b  (a  ©  t  =  b)  is  uniquely  soluble  for  a,  where  t  G  (F^)^  is  the 
template  based  on  the  set  C  =  {cj,  .  .  .  ,c„},  t  =  B(C),  I  Y|  =  n. 

We  can  now  define  linear  independence.   Let  F^^^  be  a  given  belt.   Then  linear 
independence  is  the  negation  of  linear  dependence:   Cj,  .  .  .  ,c„  G  F^^^^  are  linearly  indepen- 
dent when  no  one  of  them  is  linearly  dependent  on  the  others.   How  is  linear  dependence 
related  to  strong  linear  independence? 
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Theorem  3.27.   Let  F^^  be  a  bounded  l-yroup,  and  Cy,  .  .  .  ,Cj^  E  F^^.    For  c,,  .  .  .  ,Ci^  to 
be  linearly  independent  it  is  sufficient,  but  not  necessary,  that  Cj,  .  .  .  ,C|;  be  SLI. 

We  may  call  the  above  definition  of  SLI  riylit  SLI.   If,  in  the  definition  of  SLI,  we  were 
to  multiply  by  the  scalars  Xj's  from  the  left,  we  define  the  concept  of  left  SLI.   If  formula 
(3—8)  is  replaced  by 

b  =  A  a(j^.)  Q  Xj^     {  or  b  =  X  a(j^,)  ®  Xj^) 
then  we  have  the  concept  of  right  dual  SLL   VVc  define  in  an  analogous  way  the  concept  of 
left  dual  SLI. 

3.3.    Rnnk  ofTeiiiplntes 
Templnte  rank  over  a  bounded  l-grniip.  Let  F^^^  be  a  bounded  1-group  and  t  €.  (F^) 
be  arbitrary.   We  call  the  template  t  (right)  or  left  column  regular  if  the  set  of  images 
{^'x  }x€X  ^^^  ('"ight)  or  left  SLI,  respectively.    We  say  t  is  right  or  left  row  regular  if  the  tem- 
plate t'  is  right  or  left  column  regular,  respectively. 

Now  suppose  that  F^^^^  is  a  bounded  1-group  and  t  G  (F^)^.   Suppose  r  is  the  max- 
imum number  of  images  t'^^  of  t  that  are  SLI.   In  this  case  we  say  that  t  has  column  rank 
equal  to  r.   The  row  rank  of  t  is  the  column  rank  of  t'.   For  a  template  t  G  (F^)    ,  we  say 
that  t  has  (fyastic  rank  equal  to  r  G  Z"*"  if  the  following  is  true  for  k  =  r  but  not  for  k  >  r: 

Let  W  be  a  coordinate  set,  I  Wl  =  k  <  min(m,n).    There  exist  a  G  F     and  b  G  F    , 
both  finite,  such  that  the  template  s  G  (F^)     is  doubly  <;i-astic  and  s  contains  a 
strictly  doubly  (;i-astic  template  u  G  (F^^)^^,  where 

Sji(xj)    =  b(yi)  -I- ty^(xj)  +  a(xj) ,  V  i  =  l,...,n  and  j  =  l,...,m 
if  F  =  R,  and 
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Sy,{Xj)   =  b(yi)  *  ty^(Xj)  *  a(Xj),  V  i  =  l,...,n  and  j  =  l,..,m 
if  F  =  R+. 

Lemma  3.28.   LetY^^  be  a  bounded  l-group  tvilh  group  F  E  {RjR"*"},  and  suppose  that 
t  G  (F^^)     has  (f)-astic  rank  equal  to  r.    Then  t  is  doubly  F-astic  and  t'  contains  a  set  of  at 
least  r  images,  t'^  ,  k=l,...,r,  which  are  SLI. 

Lemma  3.29.   Let  F€  {RiR"^},  and  suppose  that  t  G  (F^)^  is  doubly  F-astic  and  con- 
sists of  a  set  of  V  images  which  are  SLI.    Then  t  has  <i)-astic  rank  equal  to  at  least  r. 

Accordingly,  we  have 
Theorem  3.30.   Le/F6  {R,R+},  and  suppose  Ihatt  G  (F^j"^'  is  doubly  F-astic.    Then 
the  following  statements  are  all  equivalent: 

(i)  t  has  <^astic  rank  equal  to  r 

(ii)  t  has  right  column  rank  equal  to  r 

(iii)  t  has  left  row  rank  equal  to  r 

(iv)  t    has  dual  right  column  rank  equal  to  r 

(v)  t   has  dual  left  row  rank  equal  to  r  . 

If  t  is  doubly  F-astic,  then  we  can  apply  Theorem  3.30  and  simply  use  the  term  rank  of 
t,  for  ranks  (i)  to  (iii),  and  the  term  dual  rank  of  t  for  ranks  (iv)  and  (v).   If  the  bounded  1- 
group  Fj.00  is  commutative,  as  in  both  our  cases,  we  have  the  following 

Corollary  3.31.    Le/FG  {R.R"^},  and  let  t  G  (F^J^'  be  doubly  F-astic.    Then  the  fol- 
lowing statements  are  all  equivalent: 

(i)  t  has  left  column  rank  equal  to  r 

(ii)  t  has  right  row  rank  equal  to  r 

(iii)  t   has  dual  left  column  rank  equal  to  r 

(iv)  t    has  dual  right  row  rank  equal  to  r  . 
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3.3.1 Evistpppp  of  Rank  and  Rplatinn  to  ST,T 

We  now  discuss  the  existence  of  the  rank  of  a  template  and  the  relationship  of  rank  to 
SLI. 

Theorem  3.32.   LetFe  (R.R"*"},  arid  let  t  G  (F^j"^'.    Then  there  is  an  integer  r  such 
that  t  has  4>-astic  rank  r,  if  and  only  ift  is  doubly  F-astic.    In  this  case,  r  satisfies  1  <  r  < 
min(m,n),  where  m  =|x|,  n  =1  Y|. 

We  now  have  the  tools  to  show  that  the  previous  dimension  anomalies  are  avoided  in 
context  of  strong  linear  independence. 

Theorem  3.33.    Le^FG  {RiR"*"},  X  an  arbitrary  non-empty,  finite  coordinate  set  with 
I  X|  =  m.    Then  for  each  integer  n,  1  <  n  <  m,  we  can  find  n  images  on  X,  a:  G  F^,  j  = 
l,...,n  which  are  SLI.    This  is  impossible  for  n  >  m. 

3.3.2 Permanents  and  Tnversps 

As  in  linear  algebra,  if  t  is  a  matrix  all  of  whose  eigenvalues  satisfy  I  X|  <  1,  then  the 
expression 

(e-t)-i   =  e  +t  +t-+  •  •  • 
is  valid.   We  state  an  analogous  case  in  the  image  algebra. 

For  a  bounded  1-group  F^^^,  a  template  t  G  (F^^)''^  is  called  increasing  if 

a  M  t  >  a  for  all  a  G  F^^,  and      s  M  t  >  s   for  all  s  G  (F^)^, 
where  Y  is  any  arbitrary  coordinate  set. 

We  have 

Lemma  3.34.   Let  F^.^^  be  a  bounded  l-group,  and  let  t  G  (F^)    .    Then  t  is  increasing  if 
and  only  iftj^x)  >^\/x  G  X. 
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Let  t  G  (R^^)     be  a  template,  |X|  =  rn.   We  define  the  permanent  oft  to  be  the 
scalar  Perm(t)  E  H^oo  given  by 

rn 

Pem.(t)    =  V(St   (x^;,), 

<7        1  =  1 

where  the  maximum  is  taken  over  all  permutations  a  in  the  symmetric  group  S^  of  order  m!. 

For  the  bounded  1-group  R+^,  let  t  €  ((R+^)^")^  be  a  template,  |x|  =  m.   We  define 

the  permanent  oft  to  be  the  scalar  Perm(t)  G  R_^^  given  by 

m 

Perm(t)   =  V(nt  (x^;,), 

<T        1  =  1     '' 

where  again  the  maximum  is  taken  over  all  permutations  a  in  the  symmetric  group  Sj„. 

The  adjugate  template  of  t  G  (F^)-^  is  tlie  template  Adj(t)  defined  by 
[Adj(t)]y/Xj)   =  Cofactor[t],/yi) 
where  Cofactor[t]   (yj)  is  the  permanent  of  the  template  s  defined  by 

h  =  l,...,j— l,j+l,...,m  and  k  =  l,...,i— l,i+l,...,m . 
Here,  s  G  (F2^)^^,  where  I  W|  =  m-1.   For  m  =  1,  we  define  Adj(t)  =  (f). 

3.3.3.    Crnph  Theory 

We  now  present  some  graph  theoretic  tools  which  will  be  used  later. 

A  digraph  or  directed  graph  is  a  pair  D  =  {V,E}  where  V  is  a  finite  set  of  vertices 
{l,...,n}  and  E  C  V  x  V.   The  set  E  is  called  the  set  of  edges  of  D.   An  edge  {i,j)  is  directed 
from  i  to  j,  and  can  be  represented  by  a  vector  with  tail  at  node  i  and  head  at  node  j. 

A  graph  is  a  pair  G   =  {V,E}  where  V  is  a  finite  set  of  vertices  {l,...,n}  and  E  C  V  x  V 
such  that  (i,j)  G  E  if  and  only  if  (j,i)  G  E. 
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A  u-v  path  in  a  digraph  or  grapii  is  a  finite  sequence  of  vertices  u  =yo,  Yi,  ---Jm  ~  ^ 
such  that  (jj,  Yj^i)  E  E  for  all  j  =  0,...,m-l.   A  circuit  is  a  path  with  the  property  that 
Yo  =  y^.   A  simple  path  y^,  y^,  ...,y^,  is  a  path  with  distinct  vertices  except  possibly  for  yg 
and  y^j,.   A  simple  circuit  is  a  circuit  which  is  a  simple  path. 

A  weighted  digraph  {graph)  is  a  digraph  (graph)  to  which  every  edge  (i,j)  is  uniquely 
assigned  a  value  in  F^^^.   We  denote  the  weight  of  the  edge  (i,j)  by  t(i,j)  or  tjj.   Note  that  the 
value  tjj  is  not  necessarily  equal  to  the  value  t:|. 

We  remark  that  if  G  =  {V,E}  is  a  graph  then  if  there  exists  a  u-v  path,  there  exists  a 
v-u  path. 

With  each  path  (circuit  )  cr  =  yg,  y^,  ...,y^  of  a  weighted  graph  G,  there  is  an  associated 
path  (circuit)  product  p{a),  defined  by 

^V      V        ^       '^U      V        ^  '      '      '         X       t„  ... 

For  each  template  t  G  (F^)-^  where  |xl  =  n,  we  can  associate  a  weighted  graph  A(t) 
in  the  following  way.   The  associated  graph  A(t)  is  the  weighted  graph  G  =  (V,E),  where  V 
=  {1,2,. ..,n},  and  whose  weights  are  t^j^x-^),  for  the  pair  (i,j)  such  that  Xj  G  S_^{t^ ).  The  pair 
(i,j)  is  then  considered  an  edge.   If  tj,j(xi)  =  -oo,  then  we  can  extend  E  to  all  of  V  X  V  by 
stating  that  (i,j)  G  E  with  null  weight  — oo.   An  example  of  a  template  t  and  its  associated 
weighted  graph  A(t)  is  given  below  in  Figure  7.   We  have  omitted  listing  the  values  of  — oo 
on  A(t).   Here,  Ixl  =3. 
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Figure  7.  A  Template  and  its  Associated  Graph. 

(a)  A  Template  t;  (b)  Associated  Graph  A(t). 


For  the  belt  ^ _^,  the  correspondence  is  one-one.   We  note  this  in  the  next  theorem. 

Lemma  2.48.    Ltl  Y_^  be  a  belt,  where  +oo  ^  F.    Let  a  :  (F^^)^  -*-g={G:Gisa 
weighted  graph  with  n  nodes  }  be  defined  by  a(t)  =  A(t).    Then  a  is  one-one  and  onto. 

Proof:  Suppose  a{t)  =  q(s).   Let  {  t^  (x^)  }  be  the  weights  for  A(t)  and  {  aj^{x-^)  }  be  the 
weights  for  A(s).   By  definition,  t^  (xj)  =  s^^  (xj)  for  all  i,j,  and  hence  t  =  s. 


75 

Now  suppose  that  G  =  (V,E)  is  a  weighted  graph  with  weights  {  Wjj  }.   Define 

t  6  (F>J^  by  t^j(xi)  =  Wjj,  if  (ij)  G  E,  and  t^  (x;)  =  -oo  otherwise.  Then  a(t)  = 

G. 

Q.E.D. 
Let  t  G  (Flg^)'  .   If  for  each  circuit  a  in  A(t)  we  have  p(<7)  <  (^  and  there  exists  at  least 
one  circuit  cr  such  that  p(<t)  =  (j),  then  we  call  t  a  definite  template. 

Lemma  3.35.    A  template  t  G  (F^)^  is  definite  if  and  only  if  for  all  simple  circuits 
o  G  A(t),  p((7)  <  ^  and  there  exists  at  least  one  such  simple  circuit  a  such  that  p{a)  =  (j). 

Theorem  3.36.    Lett  G  (Fi^)^  be  either  row-(f>-astic  or  coiumn-<f>-astic.    Then  t  is 
definite. 

Theorem  3.37.    Let  t  G  (Fi^)^.    IJ  t  is  definite  then  so  is  f,  for  any  integer  r  >  0. 

Let  t  G  (F^)^  where  Ixl  =  n.   The  metric  template  generated  by  t  is 

r(t)   =  t  V  t-  V     •  ■   V  t" . 
The  dual  metric  template  is 

r*(t)  =  t*A(t-)'A  •■■  A(t")*. 
The  name  7netric  originates  from  the  application  of  the  minimax  algebra  to  transporta- 
tion networks.   If  for  the  bounded  l-group  R.^^^  the  value  t^(xj)  represents  the  direct  distance 
from  node  i  to  node  j  of  a  transportation  network  with  t^  (x,)  =  +oo  if  there  is  no  direct 
route,  then  (  r(t))   represents  the  shortest  distance  matrix,  that  is,  ((  r(t))*  j^^  (xj)  is  the  shor- 
test path  possible  from  node  i  to  node  j  of  all  possible  paths.   A  description  of  a  transporta- 
tion problem  concerning  shortest  paths  is  discu.ssed  in  Cuninghame-Green's  book  [38]. 
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Theorems  3.38  through  3.40  arc  used  to  prove  Theorem  3.41. 
Lemma  3.38.    Le<tG(Fi^)^.    Then 

r(t)  -  ( 1 V  t )"-!  M  t . 

Lemma  3.39.   (tVl)""^    =  IVtV   ■■•    V  t"-^  t  €  (F^^)^. 
Theorem  3.40.   Let  t  e  {F^J^  be  definite.    Then 

t'    <   r(t)  ,  r  =  1,2,... 
Theorem  3.41.    Lett  G  (F^J^'  be  definite.    Then 

imr  <  r(t),r  =  i,2,... 

r(t)    =  (1  Vt)'-  M  t  ,r  =  l,2,...,n-l. 
Using  the  Adjugate  of  a  template,  we  have 

Theorem  3.42  [52].    Let  F^^  be  a  commutative  bounded  l-group  and  t  G  (F^)^  be 
definite  and  increasing.    Then  Adj(t)  =  r(t). 

Now  we  define  the  inverse  of  a  template.   For  t  G  (F^)-^,  we  define 

Inv(t)   =  (Perm(t))-i  M  Adj(t)     (or      Inv(t)   =  (Perm(t))-i  ®  Adj(t)   ) 
by  direct  analogy  in  elementary  linear  algebra. 

We  note  that  the  template  Inv(t)  is  not  necessarily  invertible  in  the  sense  that 
Inv(t)  M  t  =  1,  for  example. 

3.3/1 Invertihility 

In  order  to  define  an  invertible  template,  that  is,  a  template  t  G  (F^)-^  that  has  the 
property  that  there  exists  a  unique  template  s  satisfying  tM  s=sM  t=l 
(t  ®  s  =s  ®  t  =  1),  we  need  to  introduce  the  concept  of  equivalent  templates. 
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Let  F^^  be  a  subbelt  of  R^^  or  R^^.   A  template  p  G  ( F^)  ''^  is  said  to  be  invertible  if 
there  exists  a  template  qE(F^)-^  such  that  p  M  q=qM  p=l  (p®  q=q®  p=l)- 

These  templates  can  be  described  in  close  detail.   Let  us  define  a  strictly  doubly  Y-astic 
template  over  a  bounded  1-group  F^;,^  to  be  an  element  t  of  (F^)-^  satisfying 

(i)       ty^(Xj)  <  +00,  i,j  =l,...,n 
(ii)       for  each  index  i  there  exists  a  unicjue  index  j|  G  {l,2,...,m}  such  that  ty(xj)  is  finite. 

Theorem  3.43.  Let  Y^^  be  a  bounded  l-group  with  group  F  and  let  p  €  (F^^)^  be  given. 
Then  p  is  invertible  if  and  only  if  p  is  strictly  doubly  F-astic. 

As  is  usual,  if  p  is  invertible,  then  the  template  q  above  is  written  as  p~^ 

The  intersection  of  the  set  of  strictly  doubly  (jVaatic  templates  and  the  set  of  strictly 
doubly  F-astic  templates  we  call  the  permutation  templates.   It  is  not  difficult  to  show 

Proposition  3.44.  LetF^^  be  a  bounded  l-group.    Then  the  set  of  invertible  templates 
from  X  to  X,  where  Ixl  =  m,  form  a  group  under  the  multiplication  M  (®),  containing  1  as 
the  identity  element  and  having  the  permutation  templates  as  a  subgroup  isomorphic  to  the 
symmetric  group  S^^  on  m  letters. 

Pre-  or  post-multiplication  of  a  template  t  by  a  permutation  template  p  will  permute 
the  images  t'^  or  the  images  t^  of  t,  respectively,  and  these  permutation  templates  play  a 
role  exactly  like  their  counterparts  in  linear  algebra. 

3.3.5.    Eqnivniencp  of  Templntes 

Let  F^oo  be  a  bounded  l-group,  and  let  t,  s  G  (F^)"^'  be  given.   We  say  that  t  and  s 
are  equivalent,  written  t  =  s,  if  there  exist  invertible  templates  p  £  (F^^,)^  and 
q  e  (F^)^  such  that  pM  tM   q=s(p®t©q=s). 
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Now  we  define  elementary  templates.   An  elementary  template  p  G  (F^)^over  a 
bounded  1-group  with  group  F  is  one  of  the  following: 

(i)       a  permutation  template 

(ii)      a  diagonal  template  of  the  form  diag(<;4,  ...,(j),a,(j),  .  .  .  ,  (j)),  where  a  G  F. 

Elementary  templates  correspond  to  matrices  which  perform  elementary  operations  on 
matrices  [38].   A  permutation  template 

1.  permutes  the  images  t'^^  of  t;  or 

2.  permutes  the  images  t    of  t, 

depending  on  whether  the  multiplication  is  from  the  left  or  right,  respectively.   Diagonal 
templates  of  the  type  listed  in  (ii)  above  have  the  efl'ect  of  multiplying  some  image  t'^  of  t  by 
a  finite  constant  a,  or  multiplying  some  image  ty  of  t  by  a  finite  constant  a,  depending  on 
whether  the  multiplication  of  t  is  from  the  left  or  right,  respectively. 

Lemma  3.45.   Let  Y^^  be  a  bounded  l-group,  and  let  X  and  Y  be  given  coordinate  sets, 
IXl  =m,|  YI  =n.    Then  the  relation  of  equivalence  is  an  equivalence  relation  on  (F^)^  .    If 
t,sG(F^^)    ,  then  t  =  s  if  and  only  if  there  is  a  sequence  of  templates  Uo,Ui,  .  .  .  ,U|  such 
that  Uq  =  t  and  Uj  =  s,  and  Up  is  obtained  by  an  elementary  operation  on  u     j,  p  =  l,...,j. 

Permutation  and  diagonal  templates  of  this  form  will  play  an  important  role  in  the  dis- 
cussion on  local  template  decompositions,  as  well  as  the  following  theorem. 

Lemma  3.46.   Let  Y^^  be  a  bounded  l-groiip  with  group  F  and  let  t  G  (F^)^  be  given. 
If  a  given  image  oft'  [or  t)  is  F-astic  then  t  is  equivalent  to  a  template  in  which  that  image 
oft'  (or  t)  is  <f>-astic  and  all  other  images  in  t'  (or  t)  are  identical  with  the  corresponding 
image  in  t'  (or  t).    Hence  ift  is  (row-,  column-,  or  doubly)  F-astic  then  t  is  equivalent  to  a 
template  which  is  (respectively  row-,  column-,  or  doubly)  (l)-astic. 
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Rquivalenpe  anri  rank  The  following  are  results  which  show  the  relation  between 
equivalence  and  rank. 

Proposition  3.47.  Let  F^^o  ^^  «  bounded  l-group,  and  lett,  a  E  (F^)"^.    Then  t  has  (f)- 
astic  rank  equal  to  r  {/  and  only  if  the  following  statement  is  true  for  j  =r  but  not  for  j  >  r  : 

t  is  equivalent  to  a  doubly  (f>-astic  template  d  which  contains  a  strictly  doubly  <^ 
astic  template  u  G  (F^^)^^,  where  I  W|  =  j. 

Corollary  3.48.    Let  F^^  be  a  bounded  l-group  with  group  F  and  lett,  a  E  (F^)"^  be 
equivalent.    Then  if  either  t  or  a  has  a  rank,  then  so  does  the  other,  and  the  ranks  are 
equal. 

3J — The  Eigenprohlem  in  the  Tmnge  Algebra 

Using  the  isomorphism,  we  can  discuss  the  eigcnproblem  which  is  presented  in  its 
matrix  form  [38]  in  context  of  the  image  algebra.   In  this  section  we  present  the  eigenproblem 
and  solution  in  image  algebra  notation. 

3.4.1.    The  Statement  in  Image  Algebra 

Unless  otherwise  stated,  we  assume  that  F  is  a  subbelt  of  either  R  or  R'^,  and  let  F^.^^, 
F_oo,  and  F^^^  have  their  usual  meanings.  The  coordinate  sets  X  and  Y  are  assumed  to  be 
non-emi)ty,  finite  arrays,  with  Ixl  =  m  and  I  Y|  =  n. 

Let  X  G  F^oQ.   Let  X  G  (F^)-^  be  the  one-point  template  defined  in  the  usual  way  by 

/      X        x=y 

^^  '  [   —oo      otherwise 

Suppose  F  is  a  subbelt  of  R,  and  t  G  (F^)'"^.   Then  the  eigenproblem  is  to  find 
a  G  F^  and  X  G  F^^o  such  that 
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a  M  t    =   a  M  X  . 
Similarly  for  the  operation  ©,  we  need  find  a  G  F'^  and  X  G  F^.^  such  that 

a  ®  t    =  a  ©  X  . 
For  either  belt,  if  such  a  and  X  exist,  then  a  is  called  an  eigenimage  of  t,  and  X  a  correspond- 
ing eigenvalue.   The  eigenproblem  is  called  finitely  soluble  if  both  a  and  X  are  finite. 

As  mentioned  before,  all  results  of  this  section  are  applicable  for  F  a  subbelt  of  with  R 
or  R"*".   Hence,  to  avoid  stating  all  results  for  both  bells  separately,  we  will  state  the  results 
for  M  with  the  understanding  that  in  all  theorems,  definitions,  etc.  in  this  section  of  Chapter 
3,  with  the  exception  of  Theorem  3.57,  M  can  be  replaced  by  ®  everywhere  and  the 
theorems  and  results  will  still  hold. 

Theorem  3.49.  Let  t  G  (F'"^)'^'.  Then  there  exist  a  G  (F^'oo)^  such  that  ifh  is  in  the 
column  space  oft,  then  b  is  an  eigenimage  of  a  with  corresponding  eigenvalue  4>.  Here, 
8  =t*  Q  t  G(Ff^)^.   Hence,  b|21t  =  bMl=b. 

Theorem  3.50.    Lett  G  (F^^)^.    If  the  eigenproblem  for  t  is  finitely  soluble,  t  must  be 
row-F-astic.    In  particular,  ift  is  row-<l>-aslic,  then  the  eigenproblem  for  t  is  finitely  soluble, 
in  which  case  \  —  (f). 

Let  t  G  (F^)^  be  definite.   We  know  that  A(t)  has  at  least  one  circuit  a  such  that 
p((t)  =  </>.   An  eigennode  of  A(t)  is  any  node  on  such  a  circuit.   Two  eigennodes  are 
equivalent  if  they  are  both  on  any  one  such  circuit. 

Lemma  3.51.    Let  t  G  (F^)-^  be  definite.    Then  T(t)  is  definite,  and  if}  is  an  eigennode 
o/A(t),  then 

(r(t)),/xj)  =  4>. 

Conversely,  if  {  r(t))  (Xj)    =  (f)  for  some  Xj  G  X,  then  j  is  an  eigennode  of  A{t). 
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Lemma  3.52.    Let  t  G  (F^)^  be  definite.    If]  is  an  eigennode  o/A(t)  then 

aJ  M  t   =  aJ  M  1   =  a^ 
where  a)  is  the  image  [  r(t)  ]'^  . 

Thus,  images  [r(t)j'^,  where  j  is  an  eigennode  give  us  eigenimages  for  the  template  t, 
with  corresponding  eigenvalue  (j).   For  a  given  t,  the  set  of  all  such  images  are  called  the  fun- 
damental eigenimages  for  t.    Just  as  in  the  case  for  matrices,  two  fundamental  eigenimages 
are  called  equivalent  if  nodes  j  and  h  are  equivalent,  and  otherwise  the  eigenimages  are  non- 
equivalent. 

Theorem  3.53.    Lett  G  (F^)^'  be  definite.    If  &\  a''  €  F^  are  fundamental  eigenvectors 
oft  corresponding  to  equivalent  eigennodes ]  andk,  respectively,  then 

a}   =  a.^  M  a, 
where  a  EF,  and  a  G  (F^)'^  is  the  one-point  template. 

.S  4  2     F.igenspaees 

^f  *  €  (F^)^  is  definite,  let  {a.'\  .  .  .  ,  a^""}  be  a  maximal  set  of  non-equivalent  funda- 
mental eigenimages  of  t.   The  space  <  a^\  .  .  .  ,  a^"  >  generated  by  these  eigenimages  is 
called  the  eigenspace  oft. 

Theorem  3.54.    Let  t  G  (F^)-^  be  given.    If  the  cigenproblem  for  t  is  finitely  soluble  then 
every  finite  eigenimage  has  the  same  unique  corresponding  finite  eigenvalue  X.    The  tem- 
plate t  M  —X  is  defiinite,  and  all  finite  eigenimages  oft  lie  in  the  eigenspace  oft  M  —X. 
The  non-equivalent  fundamental  eigenimages  which  generate  this  space  have  the  property 
that  no  one  of  them  is  linearly  dependent  on  (any  subset  of)  the  others. 
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The  unique  scalar  in  Theorem  3.54,  when  it  exists,  is  called  the  principal  eigenvalue  of 
t. 

We  call  a  bounded  1-group  F  radicable  if  for  each  a  G  F  and  integer  k  >  1,  there  exists 
a  unique  f  €  F  such  that  f''  =  a. 

Some  examples  of  radicable  bounded  1-groups  are  R^^,  Q±oo'  ^"^  R^^.   However,  Z^^ 
is  not  radicable.   Choosing  a  =  12  and  k  =  5,  solving  for  f  in  the  equation 

f^  =  12 
is  just  solving  for  f  in  (using  regular  arithmetic) 

5f  =  12 
which,  of  course,  has  no  integral  solution. 

Let  F  be  a  radicable  bounded  1-group,  and  t  G  (F^)-'^.   Let  a  =  y^,  yj,  ...,y^  be  a  cir- 
cuit in  A(t).   We  define  the  length  of  a  to  be  m.   For  each  circuit  a  in  A(t),  of  length  l{a) 
and  having  circuit  product  p(cr),  we  define  a  circuit  mean  //(cr)  G  F  by 

[//(cT)]'H   =  p{a). 
We  also  define 

X(t)   =  V  {  n{o)  :  cr  is  a  simple  circuit  in  A(t)}. 

For  the  template  and  associated  graph  A(t)  in  Figure  8,  we  have  the  following  compu- 
tations. 
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Simple  Circuit  (7       p(a)       I  (a)       i,i{a) 


(1,1) 

1 

4 

(2,2) 

-1 

-1 

(3,3) 

7 

7 

(1,2,1) 

5 

2 

5/2 

(2,3,2) 

—oo 

2 

— oo 

(3,1,3) 

—  oo 

2 

— oo 

(1,2,3,1) 

1 

3 

1/3 

(3,2,1,3) 

—  oo 

3 

— oo 

Figure  8.   Computation  of  the  Circuit  Mean  |/(cr). 

In  this  example,  X(t)  —  7. 

3. 4.3.    Solutions  to  the  Eigenprnhlern 

We  now  present  the  relation  between  the  parameter  X(t)  and  the  principal  eigenvalue 
for  t. 

Theorem  3.55.   Let  F^^  be  a  radicable  boimded  l-group  and  let  t  G  (R^)-'^  be  given.    If 
the  eigenproblem  for  t  is  finitely  soluble  then  X(t)  is  finite,  and,  in  this  case,  X(t)  is  the  only 
possible  value  for  the  eigenvalue  in  any  finite  solution  to  the  eigenproblem  for  t.    That  is, 
X(t)  is  the  principal  eigenvalue  oft. 

Theorem  3.56.  Let  F^^  be  a  radicable  sub-bounded  l-group  ofR^^  and  let  t  G  (R^)"^ 
be  given.  Then  the  eigenproblem  for  t  is  finitely  soluble  if  and  only  if\[t)  is  finite  and  the 
template  Yi{A)  is  doubly  F-astic,  where   A  = 

{[r(t  M  -X(t))]'     ,  [r(t  M  -X(t))]'     ,  .  .  .  ,  [r(t  M  -X(t))]'     }  is  a  maximal  set  of  non- 

h  h  ■  h 

equivalent  fundamental  eigenimages  for  the  definite  template  t  M   — X(t). 
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TliP  Computntionnl  Tjm^V.  If  IxI  is  large,  and  t  6  (F^,)^\  then  to  directly  evaluate  the 
circuit  product  for  all  simple  circuits  in  t  is  very  time  consuming.    We  now  state  a  theorem 
which  makes  the  task  more  manageable  for  the  case  where  the  bounded  1-group  is  R  ^. 

Theorem  3.57.   Let   t  G  (F^)-^  be  given.    If  the  eigenproblem  for  t  is  finitely  soluble, 
then  X(t)  is  the  optimal  value  of\  in  the  following  linear  programming  problem  in  the  n+1 
real  variables  X,  Xi,...,Xn: 

Minimize  X  Subject  to  X  +  Xj  —  Xj  >  t^  (x:) 

where  the  inequality  constraint  is  taken  over  all  pairs  i,j  for  which  t^(Xj)  is  finite. 

In  Theorem  3.54,  we  noted  the  linear  independence  of  the  fundamental  eigenimages 
which  generate  an  eigenspace.   We  are  able  now  to  prove  a  stronger  result  which  has  appli- 
cations to  R^^  and  R^^^. 

Theorem  3.58   Let  F^^  be  a  radicable  bounded  l-group  other  than  Fg,  and  let  t  €(F-^)^ 
have  a  finitely  soluble  eigenproblem.    Then  the  fundamental  eigenimages  of —\{t)  M  t 
corresponding  to  a  maximal  set  of  non-equivalent  eigennodes  in  A[— X(t)  M  t]  are  SLL 
We  now  present  a  result  relating  X(t)  and  In  v. 

Theorem  3.59.    Let  F^^  be  a  bounded  l-group  and  t  E  (F^)^  be  such  that  X(t)  <  <j). 
Then 

Inv(l  Vt)   =  I  Vt  Vt-V  •  ■  ■   Vt'^ 
for  arbitrary  large  K.    Llere,  I  denotes  the  identity  template  o/(F^)^. 


CHAPTER  4 
GENERALIZATION  OF  NIATHEM/VTICAL  MORPHOLOGY 


Up  until  the  mid  1960's,  the  theoretical  tools  of  quantitative  microscopy  as  applied  to 
image  analysis  were  not  based  on  any  cohesive  mathematical  foundation.   It  was  G.  Math- 
eron  and  J.  Serra  at  the  Ecole  des  Mines  de  Paris  who  first  pioneered  the  theory  of 
mathematical  morphology  as  a  first  attempt  to  unify  the  underlying  mathematical  concepts 
being  used  for  image  analysis  in  microbiology,  petrography,  and  metallography  [16,53,54]. 
Initially  its  main  use  was  to  describe  boolean  image  processing  in  the  plane,  but  Sternberg 
[55]  extended  the  concepts  in  mathematical  morphology  to  include  gray  valued  images  via 
the  cumbersome  notion  of  an  umbra.   While  others  including  Serra  [56,57]  also  extended  mor- 
phology to  gray  valued  images  in  different  manners,  Sternberg's  definitions  have  been  used 
more  regularly,  and,  in  fact,  are  used  by  Serra  in  his  book  [16]. 

The  basis  on  which  morphological  theory  lies  are  the  two  classical  operations  of  Min- 
kowski addition  and  Minkowski  subtraction  from  integral  geometry  [13,14].   For  any  two  sets 
A  C  R"  and  B  C  R",  Minkowski  addition  and  subtraction  are  defined  as 

A  X   B  =  U  Ak    and   A  /  B  =   n   Au , 

b6B  b6B' 

respectively,  where  A^  =  {a  4-  b  :  a  G  A  }  and  B'  =  {  -b  :  b  6  B  }.   We  have  used  the  ori- 
ginal notation  as  found  in  Hadwiger's  book  [14].   It  can  be  shown  that 

A  /  B=(A'^  X   B')', 
where  A*^  denotes  the  complement  of  A  in  R".   From  these  definitions  are  constructed  the 
two  morphological  operations  of  dilation  and  erosion.   As  used  by  Serra  and  Maragos  [16,21], 
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the  dilation  of  a  set  A  C  R"  by  a  structuring  element  B  C  R"  is  denoted  by  A  HB'  and 
defined  by 

AaB'=   U  Au 

bCB' 
while  erosion  of  A  by  B  is 

A  BB  =   n   A,,   =    (A'- SBr. 

bGB' 
We  remark  that  the  actual  symbols  used  in  Serra's  and  Maragos'  papers  for  the  dilation 
and  erosion  are  ©  and  0.   To  avoid  confusion  with  the  image  algebra  operation  ©,  we  have 
replaced  ©  and  0  with  Sand  B,  respectively. 

To  avoid  anomalies  without  practical  interest,  the  structuring  element  B  is  assumed  to 
include  the  origin  0  €  R",  and  both  A  and  B  are  assumed  to  be  compact.    Unfortunately,  the 
definitions  for  dilation  and  erosion  defined  by  Serra  are  not  the  same  as  the  Minkowski 
operations.   In  addition,  while  Maragos  uses  the  same  definitions  as  Serra  for  dilation  and 
erosion,  Maragos  [21]  uses  the  identical  symbols  Hand  Swhen  defining  Minkowski  addition 
and  subtraction.   To  add  to  the  confusion,  Sternberg  defines  an  erosion  and  dilation  using  the 
same  symbols  Hand  B,  which  are  exactly  the  Minkowski  operations  [58].   The  following  table 
lists  the  three  definitions.   In  all  cases,  A^  =  {a  +  b  :  a  G  A  },  B'  =  {  — b  :  b  G  B  },  and  A*^ 
denotes  the  complement  of  A  in  R". 
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Table  2. 


addition 

subtraction 

Minkowski 

A  X   B  =  U  Ak 

b6B     " 

A  /  B=   n   Ak    =  (A-^HB'r 
b6D'                                  ' 

dilation  of  A  by  B 

erosion  of  A  by  B 

Serra 
Maragos 

AHB'=   U  A,, 
b€B'     " 

AQB'=   n   A.    =(A'=H  B)^ 
b6B'     "                          ' 

dilation  of  A  by  B 

erosion  of  A  by  B 

Sternberg 

ASB  =  U  Ak 
b6B     " 

A  BB  =   n   Au    =  (A-^fflB'f 
beB'     ^        ^             ' 

Thus  we  see  that  while  Sternberg's  dilation  of  A  by  B  is  exactly  Minkowski's  addition 
of  A  and  B,  Serra's  dilation  of  A  by  B  is  Minkowski's  addition  of  A  and  B'.   Although  both 
definitions  of  erosion  of  A  by  B  are  equivalent  to  Minkowski's  subtraction  of  A  and  B,  Serra 
uses  the  symbol  B'  while  Sternberg  uses  simply  B.   For  the  remainder  of  this  chapter  we  will 
use  Sternberg's  definitions  of  dilation  and  erosion. 

All  morphological  transformations  are  combinations  of  dilations  and  erosions,  such  as 
the  opening  of  A  by  B,  denoted  by  A  o  B, 

A  o  B   =  (A  B  B)  H  B 
and  the  closing  of  A  by  B,  denoted  by  A  •  B, 

A  •  B   =  (A  B  B)  B  B . 
However,  a  more  general  image  transform,  in  mathematical  morphology  is  the  Hit  or  Miss 

transform  [54,53].   Since  an  erosion  and  hence  a  dilation  is  a  special  case  of  the  Hit  or  Miss 
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transform,  this  transform  is  often  viewed  as  the  universal  morphological  transformation  upon 
which  the  theory  of  mathematical  morphology  is  based.  Let  B  —  (D,E)  be  a  pair  of  structur- 
ing elements.   Tiien  the  Hit  or  Miss  transform  of  the  set  A  is  given  by  the  expression 

A®B  =  {a:  D^  C  A,  E^  C  A"  }. 
For  practical  applications  it  is  assumed  that  D  fl  E  =  0.   The  erosion  of  A  by  D  is  obtained 
by  simply  letting  E  =  0,  in  which  case  we  have  A  ®  B  =  A  BD. 

While  there  have  been  several  extensions  of  the  boolean  dilation  to  the  gray  level  case, 
Sternberg's  formulaes  for  computing  the  gray  value  erosion  and  dilation  are  the  most 
straightforward,  although  the  underlying  theory  introduces  the  somewhat  extraneous  concept 
of  an  umbra.   Let  f:  R"  -*■  R  be  a  function.   Then  the  umbra  of  f,  denoted  by   i/(f),  is  the  set 
^(f)  C  R"+^  defined  by 

Zi(f)  =  {p=(x,z)GR"+':z<f(x)}. 
Again,  the  notion  of  an  unbounded  set  is  exhibited  in  this  definition,  for  in  general  the  value 
z  can  approach  -co.   Since   U(Vj  C  R'',  the  dilation  of  two  functions  f  and  g  is  defined 
through  the  dilation  of  their  umbras, 

and  similarly  the  erosion  of  f  by  g, 

i/(fHg)   =   Z/(f)BZ/(g). 
Any  function  d:  R"  -►  R  has  the  proj^eity  that  d(x)  =  max  {  z  G  R  :  ( x ,  z )  G  U{d) },  and 
thus  the  set  Z/(f  Hg)  well-defines  the  function  f  Hg.   However,  when  actually  calculating  the 
new  functions  d  =  f  Bg  and  e  =  f  Bg,  Sternberg  gives  the  following  formulae  for  the  two- 
dimensional  dilation  and  erosion,  respectively: 
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d(x,y)   =  max  [f(x  -  i,y  -  j)  +  g(i,j)]  (4.I) 

e(x,y)   =  min  [  f(x  -  i,  y  -  j)  -  g(-i,-j)  ]  (4.2) 

The  function  f  represents  the  image,  and  g  represents  the  structuring  element.   Both  f  and  g 
are  assumed  to  have  finite  support,  with  values  of  —00  outside.   Also,  in  general  the  support 
of  g  is  much  smaller  than  the  coordinate  set  X,  and  g(0)  7^—00.   So  in  practice,  the  notion 
of  an  umbra  need  not  be  introduced  at  all. 

Note  that  when  applying  these  transforms  to  real  data,  we  cannot  simply  substitute  an 
image  a  for  the  set  A,  as  the  expression  A''  becomes  meaningless  to  a  computer.   What  is 
actually  assumed  is  that  A  corresponds  to  the  black  pixels  in  a  boolean  image  a,  that  is, 
given  A  C  R",  a  coordinate  set  X  C  R"  is  chosen  and  a  two-valued  image  a  on  X  is  found, 
where  1  and  0  represent  the  two  values: 


I      if  X  e  A  C  X 
ise 


a(x)   ==    I     n        ,, 
^  '  '0      otherw 


For  the  two-dimensional  gray  value  case,  Sternberg's  formulas  (4-1)  and  (4-2)  are  easily  writ- 
ten in  computer  code,  and  this  is,  in  fact,  close  to  the  image  algebra  definition  for  dilation. 
In  short,  when  implementing  a  problem  which  is  posed  in  morphological  terms,  the  solution 
must  be  reposed  in  a  setting  which  more  closely  represents  the  computing  environment.   On 
the  other  hand,  it  has  been  established  that  the  image  algebra  comes  very  close  to  ideally 
modeling  a  large  number  of  important  image  processing  problems,  such  as  mapping  of 
transforms  to  sequential  and  parallel  architectures  [44]  and  this  dissertation,  and  expressing 
sequential  algorithms  in  a  parallel  manner  [59]. 

The  next  part  of  this  chapter  is  devoted  to  establishing  an  isomorphism  between  the 
morphological  algebra  and  the  image  algebra.  We  will  show  that  performing  a  dilation  is 
equivalent  to  calculating         ; 
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a  M  t 
for  the  appropriate  a  and  t,  and  performing  an  erosion  is  equivalent  to  calculating 

a  iZ3  t* 
for  appropriate  a  and  t. 

Let  A,B  be  finite  subsets  of  Z",  where  B  is  a  structuring  element.   Let  X  =  Z"  or 
choose  X  C  Z"  to  be  a  finite  set  such  that  A  HB  C  X.    Let  F^  denote  the  value  set  {  -oo,  0 
1,  +00  }.   Define  ^■.  2^"  -f  F^^  by  ^(A)   -  a  where 

_    I     1      if  X  G  A 
^    '  [0      otherwise 

Let   S  =  {  B  C  Z"  :  I  BI  <  00  and  0  G  B  },  and  let    I  be  the  set  of  all  F^  valued  invariant 

templates  from  X  to  X  such  that  y  G  5_^(ty).   Define  rf.    B  —*■  I  by  r]{B)  =  t  where 

I       0         if  X  G  B; 
y^   '  \     —00      otherwise' 

Lemma  4.1.  Let  ^,  i]  be  as  above.    Let  A  C  Z",  and  B  G   S  a  structuring  element.    Then 

e(ASB)   =  e(A)l21  //(B). 
Proof:  Choose  X  large  enough  such  that  A  EB  C  X.   Let  D  =  A  HB  and 

f  =  C(A)  M  /?(B)-   We  must  show  that  y  G  D  if  and  only  if  f(y)  =  L   To  this  end, 

we  note  that 

y  G  A  a  B     <=>     y  G  A^  for  some  b  G  B     <=>     y=x+bforxGA,  bGB 
<:^     X  =(-b) +y, -b  GB',x  G  A     <=>     x  G  A  and  x  =  (-b) +y  G  B'y 
<^^     a(x)  =  1  and  ^x)  =  0     <i=>       V,a(z)  +  ty(z)   =  f(y)    =   1 . 

Q.E.D. 

We  call  a  the  image  corresponding  to  A,  and  t  the  template  corresponding  to  the 
structuring  eletnent  B. 
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The  next  lemma  shows  the  correspondence  between  the  E3  operation  and  erosion. 
Lemma  4.2.  Let  ^,  r)  be  as  above.    Let  A  C  Z",  and  B  C  Z"  a  structuring  element.    Then 

e(ABB)  =  e(A)Ei  \m\*- 

Proof:  Let  D  =  A  BE  and  let  c  =  ^(A)  Q   ['/(B)]'.   We  must  show  that  y  G  D  if  and  only 
ifc(y)  =  l. 

yCD     <^=>     yGApVpGB'    <i^     y=Xp+pVpeB', 
where  the  choice  of  x^  6  A  depends  on  p.   Let  a  =  ^(A)  and  t  =  r^B).   Then 
c  =  a  E3  t   and 

c(y)    =     A  a(x)+'t;(x)   =         A       a(x)+t;(x). 
We  have 

0        ifyGB', 


ty(x)-[t,(y)]*    -    ^     ^^      otherwise- 
We  claim  that  S^^{t*)  =By.   To  show  this,  note  that 

X  G  S^^{tl)  <^  ty*(x)  =  0  =  t^(y)  <^  y  e  B'^  <;=> 

y  =  p  +  X  for  some  p  G  B'   <=>    x  =  b  +  y  for  some  b  G  B    <s^    x  G  By  . 

Thus, 

y^D    <t:5>   y=Xp+pVpGB'  <io    x^=b+yVbGB,  for  some  Xj,  G  A 
<^    b+y=xGAVbGB    <i=>    B^-  S^Jt*)  C  A  ( by  defmition  of  B)    <^ 
a(x)  =  1  V  X  G  By  C  A  and  ty(x)  =  0  V  x  G  By  =  S,^{t*)     <=:> 
A     ,  a(x)  +  t;(x)  -  ]  =c(y). 

Q.E.D. 
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Lemmas  4.1  and  4.2  include  not  only  boolean  but  gray  level  dilation  and  erosion.   How- 
ever, we  now  show  explicitly  that  Sternberg's  formulas  (1-1)  and  (4-2)  hold  in  the  two  dimen- 
sional case.   Let  f,g  :Z'  — ►  R_^  be  two  real  extended  real  valued  functions  with  finite  sup- 
port, where  f  represents  the  image  and  g  the  structuring  element.   Choose  X  to  be  either  Z^ 
or  a  finite  subset  containing  the  support  of  f  fflg.   Then  ^  :  R5^  — >■  R^^  is  the  identity 
function  restricted  to  X,  that  is,  a(x)  =  f(x),  where  a  =  ^(f).   Let  B  denote  the  support  of  g, 
B  =  {  X  G  X  :  g(x)  y^~oo  }.   Let    I  denote  the  set  of  all  R^^  valued  templates  from  X  to  X 
such  that  y  G  S_^{ty)  for  all  y  G  X.   Define  r]  :  R^'^  -.-  J  by  r]{g)  =  t  where 

g(y-x)      ifxGB'y 
—oo        otherwise ' 

Note  that  if  x  G  B'y,  then  x  =  p  -I-  y  for  some  p  G  B',  which  implies  that  g(-p)  =  g(y  — x)  is 
well-defined.   Also,  S_^{ty)  ^  By.   The  formal  relation  between  the  gray-scale  morphological 
operations  and  M  and  IZ3  are  shown  in  the  next  two  theorems. 
Theorem  4.3.    Let  f,g,  B,  and  X  be  as  above.    Then 

e(fHg)  =  ^(f)a//(g). 

Proof: 

At  location  (x,y)  G  X  C  Z", 

(aM  t)(x,y)   =     y   a(z)-Ft„,,j(3)   =:.  V  a(i,j)  +  t(,,,)(i,j), 

while  at  (x,y),  f  fflg  =  d  has  value 

d(x,y)   =    max  [  f(x  -  i,  y  -  j)  +  g(i J) ]    ^         max       [ f(i,j)  +  g(x  -i,y  -j) ] . 

C.Jjfcts  (x-i,y-j)eB 

Given  (x-i,y-j)  =(-pj -p^)  GB,  we  have  (i,j)  =(Pi,Po)  +  (x,y)  G  B',^y),  and  hence, 

f(ij)  +  g(x-i,y  -j)  =  a(i,j)  +  t(,,^,(ij)  V  (i,j)  G   B',,_^,. 
Therefore, 


93 


d(x,y)   =        max       [f(i,j)+g(x-i,y-j)]    =       max     [f(i,j)  +  g(x-i,y-j) 

(x-ij-j)€B  (i,j)6B',^y, 

^  r-^^y  u     ^^(''•i)  +  W'-J)    =  (aM  t)(x,y). 


Q.E.D. 


If  the  template  t  corresponding  to  the  structuring  element  g  has  form 

I    g(y-x)      ifxGBV 
>^  '       [        —CO        otherwise 
then  the  template  t   has  form 

I  -g(x-y)    ifyeB', 

t^,(x)  =1  ,  ,1         ■      . 

^^  '       [         -\-oc  otherwise 

Since  t*{x)  G  R  if  and  only  if  x  -y  G  B  if  and  only  if  x  G  B^,  S^^{t*)  =  By. 
Theorem  4.4.    Let  f,g,  B,  and  X  be  as  in  Theorem  4.3.    Then 

e(fHg)  =  af)B['Kg)r. 

Proof: 

At  location  (x,y)  G  X  C  Z^, 

(aEg  t*)(x,y)    =     A   a(z)4-'t(;^,(z)    =  A     .    a(ij)  +  t^^^jOJ), 

while  at  (x,y),  f  Bg  =  e  has  value 
e(x,y)    =     niin   [f(x-i,y-j)-g(-i-j)]    =  mm  [f(ij)  _  g(_x  +  i -y +j)] . 

Given  (-x+i,-y +j)  =  (b,,bo)  GB,  we  have  (i,j)  =(bi,b._,)  +  (x,y)  G  B,  and,  hence, 

f(i-j)-g(-x+i-y+j)=a(i,j)+t(;,,,(i,j)   V(i,j)G   B„y). 
Therefore, 

e(x,y)    =  min  [f(i,j)-g(-x+i,-y+j)]    =       min     [f{i,j)  -  g(-x+i,-y +j)] 

I  X+l,  J+j)fcU  (i,j)6B(jy) 


A     ^    a(i,j)+t(;,,(i,j)   =  (a|Z3  t*)(x,y). 


Q.E.D. 
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It  is  easily  ascertained  that  each  of  ^  and  t]  are  one-one  and  onto  for  each  of  the  boolean 
and  gray  level  cases.   The  functions  ^  and  r]  therefore  preserve  the  morphological  operations, 
and  in  fact  theorems  4.1  through  4.4  show  that  mathematical  morphology  is  embedded  into 
the  image  algebra.   We  condense  the  results  in  the  following  two  e.xpressions. 

a  M  t  corresponds  to  the  dilation  of  f  by  g,  f  Sg 

a  IZ3  t  corresponds  to  the  erosion  of  f  by  g,  f  Hg 

The  operation  ®  can  also  be  used  to  express  a  boolean  dilation  or  erosion.   Given  A 
C  R",  the  image  a  G  {0,1  }^  corresponding  to  A  is  defined  as  before,  while  for  a  structuring 
element  B  C  R",  the  template  t  corresponding  to  B  is  defined  by 

/     1      ifxGB'y 
'^  '  {    0      otherwise 

The  a  ®  t  corresponds  to  the  dilation  of  A  by  B,  while  a  ®  t  corresponds  to  the  erosion  of 

A  by  B.   Here,  of  course, 

f      1        ifyGB', 
^^  I,     +00      otherwise 

Thus,  the  value  set  {  -oo,  0,  1,  +oo  }  along  with  tiie  operation  M  can  be  used  to  express  a 

boolean  dilation,  where  both  input  image  a  and  output  a  M  t  are  {  0,1  }  valued  images. 

Similarly,  the  three  element  blog  F3  =  {  0,1, +00  }  along  with  the  operation  ®  can  be  used 

to  express  a  boolean  dilation,  where  both  a  and  a  ©  t  are  {  0,1  }  valued  images. 

In  the  boolean  case  it  is  a  simple  exercise  to  show  that  the  Hit  or  Miss  transform  can  be 
expressed  as 

A®B-(ABD)n(A'=BE).  (4-3) 
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If  we  let  t  be  the  boolean  template  corresponding  to  D  and  s  the  boolean  template 
corresponding  to  E,  we  obtain  the  equivalent  image  algebra  expression 

( a  IZ3  t* )  *  ( Xo(a)  El  s* ) ,  (4-4) 

or,  using  the  bounded  1-group  F3  =  {0, 1 ,  +00}, 

(a®  t)*(Ao(a)®  i).  (4-5) 

However,  there  is  an  even  simpler  image  algebra  formulation  of  the  Hit  or  Miss 
transform  which  does  not  employ  the  notions  of  minimum  or  erosion.   We  state  this  in  the 
next  lemma,  using  equation  (4-5)  as  the  representation  of  the  Hit  or  Miss  transform.   Before 
doing  so,  however,  we  introduce  the  concept  of  a  census  template.   Let  S  C  X  C  R",  where 
X  is  a  finite  array.   Suppose  every  vector  s  =  (sj ,  .  .  .  ,  s„ )  €  S  is  assigned  a  value  of  0  or  1, 
and  we  wish  to  determine  if  the  pattern  of  O's  and  I's  within  S  matches  some  predetermined 
pattern  we  want  to  identify.   One  can  uniquely  identify  every  possible  combination  of  0  and 
1  values  within  S  by  attaching  a  unique  number  to  each  combination.   This  is  done  by  using 
an  invariant  template  whose  support  is  the  set  S  and  each  weight  ty(x),  x  G  S,  is  a  distinct 
power  of  a  prime  number.    When  applied  via  the  operation  ®  to  a  boolean  image,  each  dis- 
tinct pattern  of  O's  and  I's  in  S  will  result  in  a  unique  number.   While  this  theory  is  general 
enough  to  identify  patterns  in  n-dimensional  space,  it  is  primarily  used  for  2-dimensional 
image  processing.   The  following  is  a  2-dimensional  census  template. 
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Figure  9.  An  Example  of  a  Census  Template. 

This  template  was  used  as  part  of  an  algorithm  to  determine  the  chain  code  of  a  boolean 
image  [59]. 

Lemma  4.5.  Let  t  he  the  boolean  template  corresponding  to  D  and  s  the  boolean  template 
corresponding  to  E  in  the  Hit  or  Miss  transform  (4-5).  Suppose  S_,^{ty)  =  {xj,  .  .  .  ,  x^}  and 
^+cJ^y)  =  {^k+i,  •  •  •  ,x„};  where  the  X|  are  distinct,  i  =  l,...,n.    Then 


Xja  ©  r),  where  m  =  S2'~\ 
i=l 

is  equivalent  to  computing  the  Hit  or  Miss  transform,  and  the  n-point  census  template 
r  G  (R^')^  is  defined  by 


ry(xi) 


i  =  l,...,n 


0       X  7^  Xj  for  any  i  =  l,...,n  ' 
Proof:  Note  that  a  6  {0,1  }^  and  xja  ©  r)  G  {0,1  p  also.   Let  b  =  (a  ®  t)  * 
( Ao(a)  ®  s),  and  let  c  =  ,\^(a).   Then  at  y  6  X,  expression  (4-5)  has  value 


b(y)  =  [        A  _   a(x)  *  t,(x)  ]  *  [        A       c(x)  *  i,(x) 


.Aa(Xi)*t,( 


A  _  c(xi)  *  sJxi) 


The  pixel  b(y)  will  have  value  1  if  and  only  if  each  of  the  expressions 
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X  a(xO  *  t^,(xi) 
1=1 


.    A     c(Xi)  *  S,.(Xi) 
i=k+l 


(4-6) 


(4-7) 


has  value  1.   Note  that  the  only  other  possible  value  that  (4-6)  or  (4-7)  can  assume  is 
0.   Now, 

X  a(xi)  *  tj.(xi)    =1    <^^    a(x)*yx)  =  l  Vi  =  l,...,k, 

<=>    a(xi)  =  1  and  t^.{x-)  =  1  V  i  =  l,...,k. 
Also, 


A     c(Xi)  *  S   (Xj 
i=k+l 


=  1    <=>    c(x)  *  8y(x)  =  1  Vi  =k-|-l,...,n, 


<=>    c(xi)  =  1  and  8y(xi)  =  1  V  i  =  k4-l,...,n. 
Thus,  expression  (4-5)  will  have  value  1  if  and  only  if  a(xi)  =  1  for  all  i  =  l,...,k  and 
c(xi)  =  1  for  all  i  =  k+l,...,n.   But  c(xi)  =  1  if  and  only  if  a(x;)  =  0,  and  this  is  true 
for  all  i  =  k-|-l,...,n.   Therefore  (4-5)  will  have  value  1  if  and  only  if  a(xi)  =  1  for  all  i 
=  l,...,k  and  a(xj)  =0  for  all  i  =  k-f-l,...,n.   The  image  xja  ®  r)  will  assume  a 
non-zero  value  only  when  a  ©  r  has  value  m.   This  happens  if  and  only  if  a(xi)  =  1 
for  all  i  =  l,...,k  and  a(xi)  =0  for  all  i  =k-fl,...,n,  as 

n  n 

(a©r)(y)   =       E     a(x)  ■  r,(x)    =   T,  ^x-j  ■  r^{x,)=   EBix,)-2^-' 

X  t  i(ry)  i=l  '  i=l 

k 

m  =  Yj2'~^         if  and  only  if  a(xj)  =  1  for  i  =  l,...,k  and 
i=l 

a(x|)  =0  for  i  =  k+l,...,n 
an  integer  9^  m      otherwise 

Here  we  use  the  fact  that  S{r^.)  =  5^^(t^.)  U  S^,^(a^.),  and  also  that 
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5+oo(tj.)  n  5,^(^^.)  =  0  V  y  e  X  (as  D  n  E  =  0).  Therefore  we  see  that  (4-5)  will 
have  value  1  at  location  y  if  and  only  if  \jjj(  a  ®  r )  has  value  1  at  location  y. 

Q.E.D. 

We  have  shown  that  the  subalgebra   A  =  (R-^,  J,  V,  M  ,  A,  Q  )  of  the  full  image  alge- 
bra is  isomorphic  to  the  morphological  algebra  as  described  by  Serra  and  Sternberg.   Since 
invariant  templates  with  the  target  pixel  included  in  their  support  (the  set   J)  are  a  special 
type  of  templates,  it  is  clear  that  (R^,  (R^)^,V,  M  ,A,  Q  )  is  a  much  larger  algebra  than 
the  morphological  algebra.   Templates  generalize  the  concept  of  a  structuring  element. 
Templates  can  vary  in  size,  shape,  and  weights  from  point  to  point  and  they  are  able  to 
express  a  more  general  mapping,  taking  an  image  with  possibly  values  of  -t-oo  in  m- 
dimensional  space  to  an  image  in  n-dimensional  space  if  we  replace  (R^)''^  by  (R-'^)^, 
where  X  C  R'"  and  Y  C  R".   Thus,  an  expression  of  form  a  M  t  can  represent  a  far  more 
complex  process  than  a  simple  dilation.   For  example,  let  a  denote  the  input  image  shown  in 
Figure  10(a)  and  define  t  by 


%xj)(i'J) 


0       if(x,y)=(i,j)or 

if  (x,y)  e  Sj  U  S._,  and  (0,0)  =  (i,j) 
'"^       otherwise 


where  Sj  =  {  (x,y)  :  0.9  <  ^  +  ^  <  1.1  }  and  So  -  {  (x,y)  :  0.9  <  ^  -  -^^  <  1.1  },  c 
p-         q-  "  d-         q- 

=  30,  q=15,  p-  =  q-  -I-  c",  d"  =  c"  —  q".   In  this  case  a  M  t  is  obviously  not  a  simple  dilation. 

It  is  not  at  all  clear  if  this  transformation  can  be  expressed  in  terms  of  dilations  and  erosions, 

starting  with  the  input  image  a,  and  if  this  is  indeed  possible,  if  the  resulting  expression 

would  be  transparent  enough  to  justify  the  effort.   The  input  and  output  images  are  shown  in 

the  next  two  figures. 
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(a) 


X 


y 


y 


.y' 


V 


(b) 

Figure  10.   Example  of  a  Non-morphological  Transformation, 
(a)  Input  Image  a;  (b)  Image  a  M  t. 


As  a  last  remark,  we  state  that  a  structuring  element  corresponds  to  a  square  matrix 
that  is  block  toeplitz  with  toeplitz  blocks  that  has  finite  elements  on  the  diagonal.   A  decom- 
position technique  for  a  class  of  invariant  templates  called  rectangular  templates  is  discussed 
in  Chapter  5,  and  presents  the  method  in  matrix  jis  well  as  image  algebra  notation. 


CHAPTER  5 
TRANSFORM  DECOMPOSITION 


5J — Npw  A4al,riY  Dprnrnposifion  Rpsiilf.s 

In  this  section,  we  state  matrix  results  whicli  do  not  appear  in  the  book  Minimax  Alge- 
bra and  which  are  new  results.   We  will  have  particular  use  for  nnost  of  the  material 
presented  here,  as  it  will  be  used  to  give  necessary  and  sufficient  conditions  for  local  decom- 
position of  lattice  transforms.   The  isomorphisms  are  used  to  map  matrix  algebra  techniques 
to  the  image  algebra. 

As  mentioned  in  the  introduction,  the  use  of  parallel  processors  in  computing  image 
processing  transforms  is  on  the  increase.   Most  transforms  are  not  able  to  be  applied  directly 
to  a  parallel  architecture.   Instead,  a  particular  transform  must  usually  be  mapped  to  a 
specific  architecture,  that  is,  the  limitations  of  the  machinery  upon  which  the  transform  is  to 
be  implemented  must  be  represented  in  the  mathematical  expression  of  the  transform.   For 
example,  in  the  case  of  the  neighborhood  array  processors,  this  involves  decomposing  the 
transform  into  a  sequence  of  factors  where  each  factor  is  directly  implementable  on  the 
architecture.   To  give  the  general  idea  of  this  approach,  we  represent  the  set  of  processors  by 
a  rectangular  array  X,  X  =  {(i,j)  :0<i<m,  0<j<n},  and  if  the  neighborhood  has  a 
von  Neumann  or  Moore  configuration,  then  communication  links  between  each  processor  and 
the  neighboring  processors  to  which  it  is  connected  (the  local  network)  are  represented  by 
one  of  the  diagrams  in  Figure  1. 

Here,  the  processor  x  can  distribute  and  receive  information  from  its  four  (or  eight) 
nearest  neighbors.   A  transform  t  is  represented  by  a  template  t  G  (F^)-'^.   If  we 
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can  write  t  as  a  product  of  templates, 

t   =  t^  M  t-  Q    •  ■  ■    M  t'^ 
where  each  t'  has  its  support  ^.^^(tj,)  as  a  subset  of  the  local  network  configuration  (in  this 
example,  the  von  Neumann  or  Moore  configuration),  for  all  y  G  X,  then  we  say  that  t  has  a 
local  decomposition  with  respect  to  the  network.   Thus,  the  important  consideration  in 
determining  decompositions  is  the  underlying  network  of  communication  between  processors. 
The  network  can  be  modeled  by  a  graph  or  digraph,  with  nodes  as  the  processors  and  edges 
or  directed  edges  as  the  communication  links  between  processors.   The  results  on  decomposi- 
tion that  follow  will  enable  us  to  determine  necessary  and  sufficient  conditions  on  the  graph 
of  the  network  to  guarantee  the  existence  of  a  local  transform  decomposition  under  the 
operation  of  M  or  ® . 

In  this  chapter,  we  assume  that  F±^  is  a  sub-bounded  1-group  of  R^ooO""  ^^io-  where  F 
is  the  group  of  the  bounded  1-group  F^.^^^,  and  —oo  and  +00  have  their  usual  meaning  in  con- 
text of  the  respective  bounded  1-groups.   Some  sub-bounded  1-groups  are  R^^,  Q±oo>  Z^gg, 
and  Q^^.   Further,  we  assume  that  any  matrix  described  in  these  sections,  unless  noted  oth- 
erwise, will  assume  no  values  of  +00. 

5.1.1 Preliminaries 

We  first  give  the  results  in  matrix  notation  in  section  5.1,  and  then  use  the  isomorphism 
to  map  the  results  to  image  algebra  notation  in  section  5.2. 

Properties  of  the  trnnspnse  and  cniijiignle   Recall  the  notation  t'  which  denotes  the 
transpose  of  the  matrix  t,  and  that  (t')'  =  t. 

Theorem  5.1.   Let  a  G  Al„^p,  t  G  J^j.^  be  given.    Then  (s  X  t)'   =  t'  X  s',  and 
(sX'ty   =  t'x's'. 
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Proof:  We  give  the  proof  for  (s  X  t)'   =  t'  X  s'.    The  case  where  X'  replaces  X  is  done 
a  similar  way.   First,  note  that  (s  X  t)'  G  M„,^,  and  t'  X  s'  G  M„^  also.   Let 
r  =  s  X  t,  and  u  =  t'  X  s'.   To  ])rove  the  lemma,  it  is  equivalent  to  show  that 


We  ha 


Tii   =    V    Si,   X    tv 

lt=l 


The  elements  of  the  j-th  row  of  t'  are  tjj,  toj, ...,  t^j  and  the  elements  of  the  i-th 
column  of  s'  are  Sjj.Sjo,  ...,Si„.   Thus,  the  element  in  the  j-th  row  and  i-th  column  of 
u  =  t'  X  s'  is 


Uji  =  V^  hi  X  Sih  • 


But 


Uji=  V^thjX  Sih    =    V^Sij,X  thj    -  r^j. 

Q.E.D. 

Theorem  5.2.   a  x'  b  =  (b*  X  a*)*,  where  a,  b  take  values  in  R^^  or  R+^. 
Proof:  For  matrices  of  the  appropriate  sizes,  we  know 

(fX  g)*=g*x'f*, 
as  M„^„  is  conjugate  to  M  *^„  [38].   Thus,  setting  g  =  a*  and  f  =  b*,  we  have 

( b*  X  a*  )*  =  a  X '  b  . 

Q.E.D. 

Let  \'  =  {  1,2,. ..,n  },  and  let  W:  V  — f  V  be  any  function  with  the  property  i  G  W(i)  for 
all  i.   Under  the  induced  action  of  the  isomorphism  ^~'  as  discussed  in  Chapter  2,  W 
represents  the  neighbors  of  processor  Xj  with  whom  processor  Xj  can  communicate.   That  is, 
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^"  (W(i))  represents  those  processors  in  a  network  whose  memories  processor  X;  can  directly 
access,  which  includes  itself  (as  i  G  \V(i)).   We  shall  call  W  a  configuration  function  on  V. 

An  example  of  a  configuration  function  is  the  von  Neumann  configuration  function.   See 
Figure  1(a).   As  before,  we  assume  our  coordinate  set  X  is  an  r  x  s  array,  rs  =  n.   Fix  i  G  V. 
Then  i  =  k*s  +  p,  for  some  non-negative  integers  k,p  where  0  <  p  <  s  (by  the  Euclidean 
algorithm  for  the  integers).   Let  N(i)  =  {  i  -  1,  i,  i  +  1,  i  -  s,  i  +s  },  for  i=l,...,n.   Then  the 
von  Neumann  configuration  function  W  is  defined  by  \V(i)  =  {  j  G  N(i)  ;  j  G  V,  and  j  satisfies 
one  of  the  4  conditions:  (1)  j  =  i;  (2)  j  =  h*s  -f  p,  where  h  =  k-1  or  h  =  k+1;  (3)  if  p  7^  0,  then 
j  =  k*s  -I-  2;  or  (4)  if  p  ^^^  1,  then  j  =  k*s  -1  }.   This  formulation  takes  care  of  the  truncated 
von  Neumann  neighborhood  on  the  boundary  pixels  of  X,  as  well  as  for  pixels  on  the  interior 
ofX. 

We  now  state  some  preliminary  definitions  and  concepts,  making  use  of  the  graph 
theory  developed  in  section  3.3.3. 

Define  S_^{t;)  =  {  j  G  V  :  tij  5^  -00  }.   The  set  S_^{t;)  is  called  the  support  of  tj,  in 
accordance  with  the  image  algebra  definition  of  the  support  of  a  template  at  location  Xj.   In 
fact,  *-!(  5_„^(ti))  =  5_^(ty  V  i.   Let  W  be  a  configuration  function,  and  let  t  G  Ai„„. 
We  say  t  is  local  urith  respect  to  W  if  5_^,(tJ  C  W(i)  for  all  i  G  V.   If  W  is  understood  we 

say  that  t  is  local.   A  decomposition  of  t  is  a  set  of  matrices  {t(i) }      such  that  t  =  X  t(i). 

i=I  i=l 

The  set  {t(i)}      is  a  local  decomposition  oft  G  Al„„  with  respect  to  W  if  t(i)  is  local  with 

respect  to  W  for  all  i  =l,...,j.   As  before,  if  W  is  understood,  we  say  simply  that  {t(i)}      a 

i=l 

local  decomposition  of  t.   A  weak  decomposition  is  one  in  which  V  occurs  as  a  template 
operation.   A  weak  local  decomposition  is  a  local  decomposition  that  is  weak. 
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Let  D  =  {V,E}  be  a  digraph  with  u,  v  G  V.   We  say  that  v  is  reachable  from  u  if  there 
exists  a  path  from  u  to  v  in  D.   If  u  is  reachable  from  v  and  v  is  reachable  from  u,  then  we 
say  that  the  pair  (u,v)  or  (v,u)  is  mutually  reachable  in  D.   Note  that  in  a  graph  G,  reachable 
and  mutually  reachable  are  equivalent.   A  digraph  or  graph  is  strongly  connected  if  for  all 
pairs  (u,v)  G  V  x  V,  u  is  reachable  from  v. 

We  now  present  the  correspondence  between  template  configurations  and  digraphs. 

For  every  configuration  function  W,  we  can  associate  a  graph  and  digraph  in  the  following 
way.   For  i  G  V,  let  Ej  =  {  (j,i)  :  j  G  W(i)  },  and  lot  Fj  =  {  (i,j)  :  (j,i)  G  E;  }.   The  digraph  of 

n 

W,  denoted  by  D(W),  is  the  digraph  {  V,E  }  where  E  =  U  E■^.  The  graph  of  W  is  denoted  by 

i=i 

G(W),  and  is  defined  to  be  G(W)  =  {  V,E  },  where  E  =  U  E:  U  U  F,. 

i=l  i=l 

We  remark  that  if  W  is  the  von  Neumann  or  the  Moore  configuration  function,  then 
G(W)  is  strongly  connected.   These  are  common  types  of  neighborhood  connection  schemes 
used  on  parallel  architectures. 

Now,  we  establish  the  correspondence  between  our  weighted  graph  G(W)  and  a  matrix. 
Recall  in  Chapter  3,  we  described  a  one-one  correspondence  between  a  graph  and  a  template 
t  G  (Fl^)    .   We  use  the  isomorphism  ^~^  to  map  a  template  to  a  matrix,  and  define  the 
weighted  graph  in  terms  of  the  function  a  and  ^~^   Specifically,  for  a  matrix  t  =  (tj:),  we 
define  the  corresponding  graph  A(t)  as 

A(t)   =  a{^-\t)), 
and  hence  A(t)  has  edge  weight  tji  for  the  edge  (i,j).   Let  W  be  a  configuration  function,  and 
G(W)  its  graph.   Then  any  matrix  t  associated  with  G(^V)  must  satisfy  t:j  =  — oo  if  (i,j)  is 
not  an  edge  in  G(W).   We  will  use  this  fact  in  determining  local  decompositions  for  an  arbi- 
trary matrix  t.   The  reason  for  the  exchange  of  indices  in  this  correspondence  now  becomes 
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clear.   If  (j,i)  G  E  then  j  G  W(i),  and  local  matrices  must  satisfy  the  condition  that 
S_^  (tj)  C  W(i).   Thus,  for  a  given  i  G  V,  {  j  G  V  :  j  G  \V(i)  }  represents  the  possible  indices  j 
where  tjj  need  not  have  value  -co,  or,  equivalently,  the  possible  processors  X:  who  can  com- 
municate with  processor  Xj. 

5.1.2.    T.ncal  Decompositions 

A  matrix  decomposition  of  t  is  a  set  of  matrices  t(l ),...,  t(j)  such  that  t  = 

t(l)  X  t(2)  X    •  •  ■    X  t(j).    The  t(i)  are  called  the  factors  of  the  decomposition.    We  write 

j 
t  =  X   t(i)  is  a  decomposition  of  t. 
i=l 

Lemma  5.3.    Suppose  that  a  X  t  =  r  is  a  decomposition  of  r.    Then  this  decomposition  is 
not  unique,  and  we  have  s  X  t  is  also  a  decomposition  of  r,  with 

s  =  X  X  s,     t  =  X~^  X  t 

and  X  G  F  «s  arbitrary. 

Proof:  Suppose  that  s  X  t  is  a  decomposition  of  r,  and  let  X  G  F  be  arbitrary.   Then 
X  X  s  =  s  X  X,  as  (in  our  case)  F  is  commutative.   This  implies  that 

(Xx  s)x  (X-i  X  t)   =  (s  X  X)x  (X-*  X  t) 

=  sX  (Xx  X~')X  t=sX  eX  t=sX  t=r 
Thus,  setting  s  =  X  X  s,  and  t  =  X~^  X  t,  we  see  that  s  X  t  =  r  also. 

Q.E.D. 

Lemma  5.4.    Let  t  G  M„n  be  such  that  tj|  G  F  V  i  =  l,...,n.    Then  t  is  equivalent  to  a 

matrix  s  which  has  the  property  that  s-  =  6\f  i  =  l,...,n. 

Proof:  Let  d  =  diag(tfi',  [^}, ...,  t~^).   Note  that  d  is  invertible  and  d~^  = 

diag(  tji,  Un, ..,  tnJ.   Defining  s  =  d  X  t,  we  find  that  in  computing  Sjj, 
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Sii    =  i^V  di,,  X  tki 


dii  X  tii    =   tj-i  X  tii    =   ^. 


Hence  we  have 


8    =dXt   =dXtXe 
which  implies,  since  both  d  and  e  are  invertible,  that 

t    =  d"'  X  s    =  d~'  X  s  X  e 
for  the  n  X  n  identity  matrix  e,  and,  thus,  t  is  similar  to  s  which  has  the  required 
form. 

Q.E.D. 
A  matrix  t  G  >{„„  satisfying  tj;  =  ^  V  i  =  l,-..,n  is  called  a  ^-diagonal  matrix,  or  (jh 
diagonal,  for  convenience  of  notation. 

Since  every  matrix  t  such  that  tj,  G  F  is  equivalent  to  one  which  has  4>'s  on  the  diago- 
nal, we  may  use  this  to  our  advantage  and  prove  our  theorems  for  this  special  type  of  matrix 
if  it  is  easier  to  do,  and  use  the  property  of  equivalence  to  show  that  the  theorems  hold  in  the 
more  general  case. 

A  square  matrix  t  G  H^^  is  said  to  be  lower  triangular  if  it  satisfies 

tjj  =  ~<x>  if  i  <  j 
and  upper  triangular  if  it  satisfies 

tjj  =-oo   if  i  >  j. 
Lemma  5.5.    Let  t  G  H^^  be  4>-diagonal.    Then  t  has  a  weak  decomposition  into  lower  and 
upper  triangular  matrices.    In  particular,  t  can  be  written  as 

t  =  /  Vu, 
where  I  (u)  is  lower  (upper)  diagonal,  and  /j,  =  Ujj  =  (f). 


107 


Proof:  Define  /,  u  G  A^^^  by 


'J       I  — oo    otherwise 


tij     ifi>j 
-oo    otherwise' 


It  is  easy  to  see  that  /  V  u  =  t.   Tiiis  is  because 


[/Vu];j      =     /ijVUij 


t-ij  \/-00      if  i   <  j 

-oo  Vtjj     ifi>j 


which  shows  that  /  V  u  =  t. 

Q.E.D. 
Corollary  5.6.    Let  t  G  >!„„  6e  /ou'er  or  upper  triangular  with  the  property  that  tj;  G  F  V  i. 
Theii  t  is  equivalent  to  a  matrix  which  is  (j)- diagonal. 
An  0^  matrix  b  G  ><„„  is  a  matrix  which  satisfies: 

bji  G  F  V  i  =  l,...,n,  and  bjj  =  — oo  if  i  7^  j,  except  for  a  unique  index  pair  (\',f)  such 
that  bi,j,  G  F. 

If  t  G  H^^,  then  we  use  the  notation  t|  to  denote  the  i-th  row  of  t,  and  the  notation  t^ 
to  denote  the  j-th  column  of  t.   If  a  G  E",  then  a;  denotes  the  i-th  entry  of  the  vector  a.   If 
t  G  >!„,„,  then  tjj  denotes  the  entry  at  location  (i,j).   Thus,  for  t  G  >{„,„,  (t)]  =  tjj,  and  it  is 
trivial  to  show 

Proposition  5.7.   [s  X  t)-  =8,  X  t^,  — |. 

Let  /G  M^n  be  lower  triangular  with  all  diagonal  entries  equal  to  (j).   For  k=l,...,n, 
define 
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•^c  -  e  V  [  /^  X  {e^y  ] . 

Thus,   '^c  has  form 

0 

<j)                   —00 

•'c    = 

—00 

Lemma  5.8.    If  I  G  >(„„  is  lower  triangular  and  <j)-diagonal,  then 

I    =     ^c  X  'c  X    •  •  •    X  "~'c . 

Proof:  By  induction  we  show  that  s   =    ^c  X  'c  X    •  •  •   X  "^c  has  form 

0 

/oi          <f> 

■    '32    •                   -00 

s     = 

—  00      (j) 
'til      'n2        •           'nk           ■                      -00          <l> 

(5-1) 

for  1  <  k  <  n-1.   It  is  easily  shown  that 

0 
■      hi       ■                          -00 

^c  X  -c    = 

—  CO        (j) 

—00     (f) 

'nl      'n2     -OC"    -00         .                       -00          (j) 

We  assume  that  s 

'c  X  -c  X    ■  •  ■    X  '^c  has  form  as  in  (-5-1)  f< 

Dr  1  <  k  <  n-2. 
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Assume  the  induction  step,  and  consider  s  X  '^''"^c. 

Case  1.  j  ?^  k  +  1.    (s  X  ^+^c  )J  =  s  X  ( ^+^c  )J  =  s  X  eJ,  as  ( '^^'c  f  =  e'  for  j  9^  k+1. 
/J     l<j<k 


Continuing,  s  X  e'  =s'  — 


Cj     k+1  <  j  <  n' 


k+l 


Case  2.   j=k  +  l.    (s  X  ''+M  i,k+i    =  (s  X  "^^c)  .    =SiX  {^+^cf+^ 


Vs,hX  '^+V+i-   If  i<  k+1,  then 

n=l 


VsihX  ''+V+1 


V       S:u    X  Cu  K  ,  , 

h=k+2   '"  "■''+' 


V  Sj[,  X        Cj,  it+1 


V 


k+1 
h=i+l 


V 


V  /ih  X  -00 


V 


k+1 

V    — ooX  ^'^h 
h=i+l 


h,k+l 


V 


V    —OOX   ''"'"'c 


h=k+2 


h,k+l 


'ih  '^  ^h,k+l 


n=l 


V  /.+,  h  X  - 


k+1, k+1  '^         ^k+l.k+l 


k+i,h  X  -00 


V  [^x  <!>]  V 


V 


V    Sk^,  h  X 


k+1. 


h=k+2 


k+l,h  ^  ''h.k+l 


h=k+2 


Ifi  >  k+1,  then  V  Sjj,  X  ^+\ 


v[s,x^+\,^,]  V 


k 

V 

tl=l 


'ih  ^  "-h.k+l 


V 


V    Sjh  X  ^-^\  k+1 
h=k+l  '"  '''''+^ 


V    /:.    X     -00 


V 


V      -OOX 


-h,k+l 


V[<^x  /,,^i]  V 


V     -OOX 


h=i+l 


'h,k+l 


=  /; 


110 


Thus,  for  j  =  k+1,  we  have 


(sX   "+10) 


k+K^k+l 


-OO 


k^,. 


k+1 


and  hence. 


8  X    I'+lc     = 


n,k+l 


I        I        .        I         I        .        I 
I      I      .       I       I       .       I 


Q.E.D. 


Lemma  5.9.    Let  I  G  ><„„  he  lower  triangular  and  (t)-diagonal,  and  let  ''c  be  as  above, 
k=l,...,n.    Then 

where 


—  OO 

4> 

—  CO 

'ik 

—  OO 

,  for  i  >  k+1 


—  OO  (j) 

Proof:  We  use  induction  to  show  that   ""c    =   "-'^c  X  ""'■'^c  X    •  •  ■    ''+^'''c  has  the  required 
form.   It  is  easily  shown  that   ^+-'^c  X  ^+^'^c  hiis  form 


Ill 


— oo 


'k+l,k    ^ 

'k+2,k     -O^ 

—  OO 


Let  s   =  '■''c  X  '-!■'' 


c  X 


k+l,k 


OO  (p 

c,  for  i  <  n-1.   Here,  we  assume 

eJ  if  j  7^  k 

-OO         in=k' 


'k+l,k 
'k+2,k 

'i,k 

—  OO 


Then  the  j-th  column  of  '+^''^c  X  s  is  ('+^''=c  X  s)J. 
Case  1.   j  5-^  k.     i+i'l^c  X  sJ  =  ''+^'^c  X  e' =  ''+^-^c'=e'. 
Case  2.  j  =  k. 


'"^^■'^C      X    s'*     —      \/    ''+^-^r         V    « 


If  m  <  k,  then  (5-2)  is   ''+^'^c^  X  s^  =  e,„  X  s^  =  -oo. 
For  k  <  m  <  i,  equation  (5-2)  gives  us   ''^'•''c,,,  X  s*"  = 


(5-2) 


<f>        if  m  =  k 
/n,u     if  m  =  k-|-l, 


If  m  =  i+1  then    ^+^\^^  X  3^  =  '^^\+i  X  s^  =  /i+i.k- 
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If  m  >  i+1  then   '"^^''c^  X  s''  =  -oo. 
Thus,  the  k-th  column  of  '"'''''^c  X  s  has  form 


'k+l,k 


'i+l,k 

—  OO 


-OO 

Q.E.D. 

VVe  now  state  the  main  result  of  this  section. 
Theorem  5.10.    Let  t  G  >!„„  be  a  doubiy-F-anlic  matrix  with  t;;  G  F  for  all  i  =  l,...,n,  and 
W  an  arbitrary  configuration  function.    Then  t  has  a  local  weak  decomposition  if  and  only 
if  G{W)  is  strongly  connected.    Furthermore,  there  is  at  most  one  weak  operation  of\/. 

We  prove  Theorem  5.10  in  several  steps.   First  we  show  that  strong  connectivity  is  a 
necessary  condition.   Then  we  derive  a  general  decomposition  method  for  a  matrix  t,  and 
show  how  elementary  matrices  play  a  crucial  role  in  determining  that  strong  connectivity  is 
sufficient.   In  the  proofs  we  make  no  distinction  between  matrices  with  values  in  either  belt, 
R_oo  or  R+^,  and  hence  the  operations  of  +  or  *,  denoted  Ijy  the  symbol  X  .   This  is  because 
we  will  use  the  isomorphisms  to  show  the  results  hold  for  templates  with  values  in  R^ao 
under  the  operation  M  as  well  as  for  templates  with  values  in  R^^^  under  the  operation  ©. 
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5.1.3.    Npcessnrv  nrul  Siiffifient  Conditions 

Our  first  theorem  shows  the  sufficiency. 

Theorem  5.11.    If  every  t  G  M^^  '"''^'  "  '"5''"'  decomposition  with  respect  to  W,  then  G(W) 
2S  strongly  connected. 

Proof:  We  assume  by  contradiction  that  G(W)  is  not  strongly  connected,  but  every  t  G  H^^ 
has  a  local  decomposition  with  respect  to  W.  Let  i,j  G  V  such  that  i  is  not  reachable 
from  j.   Let 

D(l)  =  {  k  G  V  :  i  is  reachable  from  k  } 
D(2)  =  {  m  G  V  :  m  is  reachable  from  j  }  . 
Note  that  D(l)  H  D(2)  =  0,  for  otherwise  z  €  D(l)  H  D(2)  implies  that  i  is  reachable 
from  z  and  z  is  reachable  from  j,  giving  i  is  reachable  from  j.   Let  t  be  a  matrix 
which  is  local  with  respect  to  W. 

First,  we  show  that  t^^  =  -oo  if  k  G  D(l)  and  m  G  D(2).   Suppose  by  way  of  con- 
tradiction that  k  G  D(l)  and  m  €  D(2)  with  t^^  7^-00.   Then  since  t  is  local  with 
respect  to  W,  m  G  5_^(tJ  implies  that  m  G  \V(k).   Thus,  (m,k)  is  an  edge  and  hence 
k  is  reachable  from  m.   However,  i  is  reachable  from  k,  so  i  is  reachable  from  m  also. 
Thus,  m  G  D(l),  which  is  a  contradiction,  as  m  is  also  in  D(2).   Thus,  i^^  =  -00  if  k 
G  D(l)  and  m  G  D(2). 

We  now  give  a  matrix  which  cannot  have  a  local  decomposition  with  respect  to  W. 
Define  t  G  .M„„  and  v  G  F^^  by 

r 

<!>        if(k,m)=(i,j)  _    I       <l>        ifk=j 

—00      otherwise  '        ^k    —         _q^      otherwise  ' 
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By  assumption,  there  exists  a  decomposition  of  t,  t  =  X  t'.   At  location  k,  the  vec- 

h=l 

tor  b  =  t  X  V  has  value 

<f>       if  k  =  i 


bk    =     V    tuu    X     V.      =     t^i   X     V:      =       I  r  1         /    ■ 

"      h=i  ^^        ^  i^j        J  (^     —cio     if  k  7<^  1 

p 
Let  p  G  {l,...,r}.   We  show  by  induction  on  p  that  for  c(p)  =  (  X  t'')  X  v,  we  have 

h=l 

Cu(p)  =  -°o  for  every  index  u  G  D(l).   If  this  is  not  true  for  p  =  1,  then  there  exists 
an  index  u  G  D(l)  such  that  cjl)  G  F,  as   V  t^^  X  v,.  =  c^(l).   (Note  that  any  t'' 

cannot  have  any  +oo  values,  as  then  t  would  have  +oo  values.)  Thus,  there  must 
exist  a  pair  (u,m)  such  that  t„\j,  G  F  and  v„,  G  F,  which  implies  that  m  =  j,  which 
implies  that  m  G  D(2).   However,  m  G  D(2)  implies  that  t^'^^  =  -oo  (as  u  G  D(l)), 
which  is  a  contradiction.   Thus,  the  claim  must  be  true  for  c(l).   Now  for  some  p 
G  {2,...,r},  by  induction  assume  the  claim  is  true  for  c(l),...,c(p-l),  and  that  it  is  not 
true  for  c(p).   Then  there  exists  a  u  G  D(l)  such  that  c^,(p)  G  F.   Therefore  there 
must  exist  an  index  m  such  tliat  t^^,  G  F  and  c„,(p-l)  G  F.   By  the  induction 
hypothesis,  m  ^  D(l).   Since  t^  is  local,  we  know  that  m  G  5_^(tJ  C  W(u)  implies 
that  u  is  reachable  from  m.   Also,  since  u  G  D(l),  i  is  reachable  from  u  so  m  G  D(l), 

which  is  a  contradiction  to  the  induction  hypothesis.   Therefore  the  claim  that  for 

p 
c(p)  =(  X  t  )  X  V,  we  have  cj^\y)  =  -oo  for  every  u  G  D(l)  is  true.   In  particular, 

it  must  be  true  for  c  =  c(r)  =  t  X  v.   Thus,  Cj(p)  =  bj  =  -oo,  which  contradicts  our 
construction  of  c.    Hence  the  proof  is  complete. 

Q.E.D. 
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It  can  be  easily  shown  that  the  set  of  all  strictly  doubly  <;i-astic  n  x  n  matrices  with 
entries  in  {  -oo,  <;i  }  is  isomorphic  to  the  symmetric  group  S„  [38].   Since  every  permutation 
a  can  be  factored  into  a  product  of  transpositions,  every  permutation  matrix  can  be  factored 
into  a  product  of  matrices  corresponding  to  transpositions.   This  leads  to  our  next  definition 
of  exchange  matrices. 

The  exchange  matrix  p'J  G  M,,,,  is  the  matrix  defined  by 


Pk^ 


(f)      if  k  =  m  and  k  7^  i,  k  ?^  j 

or  if  (k,m)  =  (i,j)  or  (k,m)  =  (j,i) 
—  00      otherwise 


b,    = 


The  matrix  p'J  corresponds  to  the  transposition  a  =  (i,j)  G  S„.   Note  that  p'J  X  a  =  b,  where 

aj     if  k  =  j 

aj     if  k  =  i  ,  for  k  =  l,...,n  . 

\     a|(  otherwise 

Lemma  5.12.    Let  (i,j)  G  V,  i  jii  j,  let  ij  denote  a  transposition  in  S„,  and  let  W  be  a 
configuration  function.    Suppose  there  exists  an  i  -  j  path  in  G(W), 

1  =ko,  kj,  ...,k,„  =j  . 
Then  the  exchange  matrix  p'J  can  be  written  as 


p^^'X   p'^'^'^X     ••  •    X   p''"-'^X   p^'^-^'^n^'x 


kjko  ^^       ik, 
X  p  '  -  X  p    '. 


Proof:  Note  that  (i,j)  G  S„  can  be  written  a.s 

(i,j)=(ik,)o(kiko)    •    •    •    o(k,„_,j).(k,„_.,k,„_,)o    ■    •    ■    o(kik.,)o(iki). 

In  the  cyclic  notation  for  the  permutation  a  =  (iJ),  let  i  — >•  j  denote  i  goes  to  j. 
Then  we  have,  for  the  above  permutation,  i  -+•  k,,  kj  — +■  k.,,  ...,  kj,,_j  — ♦  j,  which 
implies  that  i  -*  j.   We  also  have  kj  -*  i  -»•  kj;  k.^  — >-  kj  -^  k.,;...;  k^_j  -»■  k^.o  - 
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^m-v  i  "*■  km-1  —*  kn,_2  — >^  ...  -+  kj  — >■  i,  which  implies  that  k;  -*■  k;,  i  7^0,m,  and  j 
— »•  i.   We  now  use  the  fact  that  S^  is  isomorphic  to  the  set  of  all  strictly  doubly  <f>- 
astic  matrices,  where  the  permutation  a  =  {\^,\.2,■■■^m)  corresponds  to  the  permuta- 
tion matrix  p'>''=' •''"'  =  p^  defined  by 


Phk    = 


^        if(h,k)=(i,,i,+,),  r  =  l,...,m-l 

orif(h,k)=(i„,,ii) 
~'^^      otherwise 


and  the  product  of  two  permutations  cTj  ,  (To  corresponds  to  the  matrix  product 

p"^'  X  p"^'.   Thus,  for  a  =  (i,j)  = 

(iki)o(k,k.,)  •  •  •  o(k,^_iJ)o(k,„_.k„,_i)o  •  •  •  o(kik,)o(ik,),  we  have 


p'"'  X  p''''^^  X    ■  •  •    X  p"""-'^  X  p'^"--''"-' 


Xp'^'^^Xp''^-. 


Q.E.D. 


Lemma  5.13.    Let  i,j  G  V,  i  ^  j  and  let  p'J  be  the  exchange  matrix  associated  with  i,j. 
Assume  there  exists  an  i-j  path 

i=ko,  kj,  ...,k^  =j  . 
Then  the  exchange  matrix  p'J  has  a  local  decomposition  with  respect  to  W. 

Proof:  If  i  €  W(j)  then  we  are  done.   Otherwise,  use  Lemma  5.12  and  write 


p'J    =   p'*"'  X  p'^-'^-X    •  •  •   X  p'^"^'^  X  p'''^'^"^' 


X  p  '  -  X  p    ' 


Since  (k^,  k^^+i)  is  an  edge  of  the  graph  G(W)  for  all  h  =0,...,m-l,  we  know  that 
h  G  '^^'(kh+i)  and  also  that  k,,+i  G  \V(kJ  (as  G(\V)  is  a  graph),  for  all  h  =0,...,m-l. 
Also, 


s-jpr 


{'^h+i  }      if  r  =  h 
{  kh  }  if  r  =  h+1 

/]•}  otherwise 
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and  hence  S_^{p, "'  "-'')  C  \V(r)  for  all  r  =  l,...,n  and  for  all  h  =0,...,m-l.   Thus  p'J 
is  local  with  respect  to  W  for  all  h  =0,...,m-l  and  hence 

pij    =   p"^'  X  p^''^^  X    •  •  ■    X  p'^-'J  X  p'^"-^''-'  X    •  ••    X  p'''''^  X  p"'' 
is  a  local  decomposition  of  p'J  with  respect  to  W. 

Q.E.D. 
Exchange  matrices  play  an  important  role  in  the  decomposition  method,  as  we  shall  see 
shortly.   We  now  present  a  decomposition  method  for  lower  triangular  matrices. 

The  matrices  ''c  as  described  in  Lemma  5.8  are  fairly  sparse,  but  certainly  not  local 
with  respect  to  most  architectures.   Lemma  5.9  showed  that  each  matrix  ''c  can  be  written 
as  a  product  of  even  sparser  matrices,  and  in  the  next  theorem  we  show  that  these  very 
sparse  matrices  can  be  decomposed  locally.   The  matrices   ""c  (i  >  k)  are  off  matrices,  and 
each  is  equivalent  to  a  matrix  which  is  local  with  respect  to  W,  where  G(W)  is  strongly  con- 
nected. 

Theorem  5.14.    Let  b  G  A(„„  be  a  lower  triangular  off  matrix  with  off-diagonal  entry  /?  at 
location  (i,j).    Let  W  be  a  configuration  Junction  such  that  G(W)  is  strongly  connected. 
Then  b  is  equivalent  to  a  matrix  which  is  local  with  respect  to  W.    Furthermore,  b  has  a 
local  decomposition  with  respect  to  W. 

Proof:  If  j  G  W(i)  then  b  is  already  local  with  respect  to  \V.   Otherwise,  \V(i)  D  { i  },  and 
then  we  can  find  k  G  V  such  that  k  G  \V(i)  (k  y^  i),  assuming  without  loss  of  general- 
ity that  k  >  i.   Let  q'^J  =p''J.   Then  the  matrix  s  defined  by 

s  =  p'^j  X  b  X  q'^J 

is  a  matrix  which  is  local  with  respect  to  \V.   To  see  this,  note  that  b  X  q'^J 
exchanges  columns  j  and  k  of  matrix  b.   Thus, 
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i  if  h  =  m,  (h,m)  /  (j,j)  or  (h,m)  ^  {k,k) 

^j         _    ,  or  if   (h,m)  -  (j,k)  or  (h,m)  =  (kj) 

lo^  q    Jhm    -        ^  if(li,m)=(i,k) 

—  oo  otherwise 

The  matrix  s  =  p*^-*  X  ( b  X  q^J )  exchanges  rows  j  and  k  of  matrix  b  X  q'^J,  so 


(p'^ix(bXq^J))h,,    = 


<A  if  h  =  m 

0         if  (h,m)  =  (i,k) 

— oo    otherwise 


Note  that  S_^{s;)  =  {i,k  },  and  5_<^(sJ  =  {h  }  for  h  7^  i.   Since  {  i,k  }  C  W(i),  we 
have  S_^{s;)  C  W(i)  and  hence  s  is  local  with  respect  to  W.   Note  also  that  s  (in  this 
case)  is  no  longer  lower  triangular,  as  k  >  i. 

A  similar  proof  holds  for  the  case  k  <  i. 

To  show  that  b  has  a  local  decomposition,  we  write 

b  =  p'^j  X  s  X  q'^J  , 
as  (p''''")-!  =  p*"'"^  for  any  h,m  G  V.   Since  G(\V)  is  strongly  connected,  there  exists 
a  j-k  path  for  all  pairs  (j,k)  G  V,  and  hence  Lemma  5.13  applies  to  p^^.   Thus  pj""  has 
a  local  decomposition,  and  since  s  is  local  and  c^^  =  p^^,  we  have  a  local  decomposi- 
tion for  b. 

Q.E.D, 

We  are  now  in  a  position  to  prove  the  following  general  theorem. 
Theorem  5.15.    Let  I  G  M^n  be  a  lower  triangular  matrix  with  ly^  ^  —00  for  all  i=l,...,n 
and  W  a  configuration  function  such  that  G(W)  is  strongly  connected.    Then  I  has  a  local 
decomposition  with  respect  to  W. 
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Proof:  By  Corollary  5.6,  /  is  equivalent  to  a  matrix  s  where  Cjj  =  <l)  for  all  i: 

/    =dXcXe    =dXc 
where  d  is  a  diagonal  matrix.   By  Lemma  5.8,  c  can  be  written  as 

c    =     'c  X  -c  X    ■  •      X  "~^c . 
By  Lemma  5.9,  each   '^c  can  be  written  as 

''c    =   "'•'c  X  "-I'^c  X     •  •  •    '^+'■'^0 
where  the   '■'^c  are  as  in  the  statement  of  Lemma  5.9.   Since  each   '•'^c  is  an  ofif 

matrix,  we  have,  by  Theorem  5.14,  a  local  decomposition  with  respect  to  W  for  each 

rn(i,k) 


''c    =     X     8(i,k,i) 
j=i     ^     '" 


where  the  s(i,k,j)  are  the  factors  of  the  decomposition,  and  each  s(i,k,j)  is  local  with 
respect  to  \V,  and  the  number  of  factors  m(i,k)  is  dependent  on  the  values  i  and  k. 
Thus, 

/=dXc=dX[icx2cx    ■•■    X  "-'c  ] 
=  d  X  ["^c  X    •  •  ■    21c  ]  X 

[  "-C  X    •  •  ■    3-c  ]  X       ...  X  "'"-'c 

,  "'(n.l)  m(2,l)  m(n,n-l) 

=  dX[    X     s(n,l,j)x       -X     X     s(2,l,j)]x       ...X       X      8(n,n-l,j) 
j=i  j=i  j=i 

where  s(i,k,j)  is  local  with  respect  to  W  for  all  i,k,j. 

Q.E.D. 
Using  the  property  that  (sX  t)'  =  t'x  s'as  stated  in  Theorem  5.1,  we  can  prove 
the  same  sequence  of  theorems  for  an  upper  triangular  matrix  u  satisfying  Ujj  7^  -ocfor  all  i 
=  l,...,n.   Thus  we  have 
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Theorem  5.16.  Let  u  €  ><„„  be  an  upper  triangular  matrix  with  u--  E  F  for  all  i,  and  W  a 
configuration  function  such  that  G(W)  is  strongly  connected.  Then  u  has  a  local  decompo- 
sition with  respect  to  W. 

This  leads  immediately  to  the  main  theorem  of  this  chapter. 
Theorem  5.10.   Let  t  G  M„„  be  a  doubly-F-astic  matrix  with  tu  G  F  for  all  i  =  l,...,n,  and 
let  W  be  an  arbitrary  configuration  function.    Then  t  has  a  weak  local  decomposition  with 
respect  to  W  if  and  only  ifG{\\)  is  strongly  connected.    Furthermore,  there  is  at  most  one 
weak  operation  of\/. 

Proof:  By  Lemma  5.4,  we  know  an  arbitrary  matrix  t  can  be  written  in  form 

t    =   d  X  s, 
where  Sj—  <f)  for  all  i  and  d  is  a  diagonal  matrix.    By  Lemma  5.5,  s  =  /  V  u  where  / 
and  u  are  lower  and  upper  triangular  matrices,  respectively,  with  ly^  =  Uj;  =  (^  for  all 
i.   Thus, 

t  =d  X(/  Vu). 

Suppose  that  G(W)  is  strongly  connected.   By  Theorem  5.15,  /  has  a  local  decompo- 

.  .  m 

sition  /  =  X   c(j),  and  by  Theorem  5.16,  u  has  a  local  decomposition  u  =  X   r(i). 

Hence,  the  expression 

f      k  m 

dX      [  X   c(j)]    V    [  X   r(i) 

[  j=i  i=i 

is  a  weak  decomposition  of  d  X   [  /  V  u  j,  and,  since  each  c(j)  and  r(i)  is  local  with 
respect  toW,  t=dx  [/Vu]  = 

f     k  m 

dX      I  X   c(j)]    V    [  X   r(i) 
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is  a  weak  local  decomposition  of  t. 

Theorem  5.11  shows  the  sufficiency  of  the  statement. 

Q.E.D. 
As  mentioned  earlier,  this  is  by  no  means  the  most  efficient  method  of  decomposition, 
and  that  one  would  not  implement  the  decomposition  by  following  the  constructive  steps 
used  to  prove  Theorem  5.10.   The  results  and  hypothesis  of  the  theorem  are  analogous  to 
conditions  for  existence  of  solutions  of  differential  equations.   Thus,  although  the  results 
guarantee  the  existence  of  local  decompositions,  efficient  methods  for  computing  them  must 
still  be  developed. 

5.2.    Derompositinii  of  Temi)lntps 
We  now  present  the  results  without  proof  of  the  previous  section  in  context  of  the 
image  algebra,  using  the  isomorphism  *  as  defined  in  Chapter  2.   As  before,  we  let  V  =  { 
l,...,n  }  and  VV  be  a  configuration  function  on  V.   We  assume  that  X  C  Z"  is  finite  and  rec- 
tangular, of  size  h  X  k,  hk  =  n,  with  the  lexicographical  ordering  as  set  out  in  Chapter  2,  and 
that  F_^  is  a  sub-bounded  1-group  of  R_^  or  R+^.   Everything  in  section  5.1  applies  to  tem- 
plates under  either  M  or  ® .   We  will  state  the  results  using  the  symbol  M  with  the  under- 
standing that  in  this  section,  M  may  be  leplaced  everywhere  by  ®  and  +  replaced  every- 
where by  *,  and  the  results  will  still  be  valid. 

Let  a  e  F^^  and  b  €  F^  be  aibitrary.   We  define  the  outer  product  of  a  and  b  to  be 
an  element  t  G  (F^)"^',  with  gray  values  of 

t,(x)    =   a(y)+b(x). 
We  denote  the  outer  product  o(  a  and  b  by  >  a,  b  <. 
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Let  t  6  (F^)^.   A  template  decomposition  of  t  is  a  set  of  templates  t(l),...,  t(j)  such 

that  t  =  t(l)  M  t(2)  M    •  •      M  t(j).   The  t(i)  are  called  the  factors  of  the  decomposition. 

j 

We  write  t  =  M  t(i)  is  a  decomposition  oft.   The  decomposition  is  called  weak  if  the  opera- 
i=i 

tion  V  replaces  any  operation  M  in  the  decomposition.    We  say  t  G  (F^)^  is  local  with 
respect  to  W  if  S_^{t^)  C  {yj  :  j  G  \V(i)}  for  all  x,  G  X.   A  decomposition  {t(i)}  ^    of 

i=l 

*■  ^  (Fleo)"   is  called  a  local  decomposition  oft  with  respect  to  W  if  t(i)  is  local  with  respect 
to  W  for  all  i  =  1,...J. 

Lemma  5.17.    Let  s  G  (F^J^^',  t  G  (F^^)^'  be  given.    Then  (s  M  t)'   =  t'  M  s';  the  dual 
operations  also  satisfy  this  property. 

Lemma  5.18.    Suppose  thats  M  t  ^  r  is  a  decomposition  ofr.    Then  this  decomposition 
is  not  unique,  and  we  have  s  0  t  is  also  a  decomposition  of  t  where 

s  =8  M  X,    t  =  —X  M  t 
and\e¥  is  arbitrary,  X  G  (F^i^)^^'. 

Lemma  5.19.   Let  t  G  (F:^J^'  be  such  that  t^(x)  G  F  V  x  G  X.    Then  t  is  equivalent  to  a 
template  s  which  has  the  property  that  sj^x.)  =  (^  V  x  G  X.    In  this  case,  we  have 

s   =  d  M  t 
where 

d  =  diag(  -t,/xj  ,  -t,>,) , ...,  -t,_^(x„) ) . 

If  s  G  (F^.^)^  satisfies  s^(x)  =  <}>  for  all  x  G  X,  then  we  say  that  s  is  ^diagonal.  A 
template  t  G  (F^)^  is  said  to  be  lower  diagonal  if  ^(t)  is  a  lower  diagonal  matrix,  and 
upper  diagonal  if  »J'(t)  is  an  upper  diagonal  matrix.    If  t  is  lower  diagonal,  then  t  satisfies 
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V^i)  =  -oo  if  i  <  j 
and  if  t  is  upper  diagonal  then 

Vxi)  =  -oo  if  J  <  i. 

Lemma  5.20.    Let  t  G  (F^)^  be  (jydiagonal.    Then  t  has  a  weak  decomposition  into 
lower  and  upper  triangular  templates.    In  particular,  t  can  be  written  as 

t  =  /  Vu, 
where  I  {\i)  is  lower  (upper)  diagonal,  and  l^{x-^)  =  u^(x|)  =  (f).    Here, 

xjv  u  (^  _oQ       otherwise    ' 


"x/Xi) 


XjV      1/  J    <   , 

—  oo       otherwise' 


Corollary  5.21.    Let  t  e  (F^^)^'  be  lower  or  upper  triangular  with  the  property  that 
Ki'^)  €  F  V  X  G  X.    Then  t  is  equivalent  to  a  template  which  is  <j)-diagonal. 

A  template  t  G  (F^J-^  is  called  an  oi/"  template  if  ^{t)  is  an  off  matrix.   The  off-entry 
value  occurring  at  location  (i,j)  is  the  value  t^  (xj). 

Lemma  5.22.    ///  G  (F^)^  is  lower  triangular  and  <f)-diagonal.    Then 

/    =  'r  M  -r  M    •  •  ■    "~'r  , 
where 

'r    =\y   [>l,^,/,^.<], 
and  >  ,  <  denotes  the  outer  product. 

Note  that  s  =  >  1,^,  /^^  <  G  [F^J^  and 
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Thus,  s,^   =  — oo  (the  null  image  on  X),  if  h  9^  k,  and  s.    =  L  otherwise.    Of  course,  we  have 
^(s)  =    c  in  this  case. 

Lemma  5.23.    Let  /G  (F^)-^  be  lower  triangular  and  <})-diagonal,  and  let  ^t  be  as  in 
Lemma  5.22,  k=l,...,n.    Then 

^T    =:   "'"^r  El  "-^■''r  M    •  •  ■    ^+^\  ^ 
where  '■''r  G  (F^^)^"  is  defined  to  be 

0    y  =x 

'x,(Xi)       y  =  Xk_  X   =  X; 

—00    otherwise 
for  i  =  k+l,...,n. 

Note  that  each  template   '-''r  is  an  off  template,  with  off-entry  value  occurring  at  loca- 
tion (i,k). 

The  main  result  of  this  chapter  is 
Theorem  5.24.    Let  t  G  (Fi^)^'  be  a  doubhj-F-ustic  template  with  t^(x)  G  F  for  all 
X  G  X,  and  W  a  configuration  function.    Then  t  has  a  weak  local  decomposition  if  and  only 
ifG(W)  is  strongly  connected.    Furlhermore,  there  is  at  most  one  weak  operation  of\J. 

The  sufficiency  of  Theorem  5.24  is  shown  next  in  Theorem  5.25. 

Theorem  5.25.    If  every  t  G  (F^)^  has  a  local  decomposition  with  respect  to  W,  then 
G(W)  is  strongly  connected. 

The  exchange  template  p'^'^^  G  (F:^)^  associated  with  (i,j)  is  the  template  defined  by 
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P^''V)    = 


0      if  z  =  u  and  z  7»^  Xj ,  z  7^  Xj 

or  if  (u,z)  =  (Xj,Xj)  or  (u,z)  =  (xj.xj 
~'^      otherwise 


The  template  p  ''  ^  corresponds  to  the  transposition  a  =  (i,j)  G  S„  and  to  the  exchange  matrix 
p'-'.   Note  that  a  M  p*'"^  =  b,  where 


b(z) 


a(xi)  ifz=x^ 
a(xj)  if  z  =  Xj 
^(''k)     otherwise 


Lemma  5.26.    Let  X; ,  Xj  €  X,  i  5.^  j,  and  let  W  be  a  configuration  function.    Suppose  there 
exists  an'i-  ']  path  in  G(W), 

i  =  ko,  kj,  ...,k,„  =j  . 
Then  the  exchange  template  p^'*^  can  be  written  as 

p"'^^   =  p^'"^'  M  p"'''"^^  M    •  •  •    El  p-'^-"^  M  p"^--^^'  M    •  •  •    0  p"^'"^  EI  p''"'\ 
Lemma  5.27.    Let  x, ,  Xj  G  X,  i  5^  j,  and  let  W  be  a  configuration  function.    Let  p'''''^  be 
the  exchange  template  associated  with  i,j.   Assume  there  exists  an  i-j  path 

i  =k(,,  ki,  ...,k,„  =j  . 
Then  the  exchange  template  p"'"^  has  a  local  decomposition  with  respect  to  W. 

We  now  present  a  local  decomposition  method  for  an  off  template. 

Theorem  5.28.    Let  a  G  (F^)*^  be  a  lower  triangular,  (j)-diagonal  template  with  off-entry 
value  of  i3  at  location  (i,j): 


s.v,(x,J    = 


</>     k  =  m 
/^    (k-n.)=(j,i) 
-00    otherwise 
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Let\W  be  configuration  Junction  such  that  G(W)  is  strongly  connected.    Then  s  is  equivalent 
to  a  template  which  is  local  with  respect  to  W.    Furthermore,  a  has  a  local  decomposition 
with  respect  to  W. 

Theorem  5.29.    Let  I  G  (F^J^'  be  a  lower  triangular  template  with  l^{x)  G  F  for  all 

X  G  X,  aiid  W  a  configuration  Junction  such  that  G(W)  is  strongly  connected.    Then  I  has  a 

local  decomposition  with  respect  to  W. 

Using  the  property  of  transpose  as  stated  in  Theorem  5.17,  we  can  prove  theorems  5.19, 
5.21,  5.22,  5.23,  5.28  and  5.29  for  upper  triangular  temphxtes. 

Theorem  5.30.   Let  u  G  (F^)^  be  an  upper  triangular  template  with  \x^{x-^  G  F  Jor  all  i, 
and  W  a  configuration  Junction  such  that  G(VV)  is  strongly  connected.    Then  u  has  a  local 
decomposition  with  respect  to  W. 

The  main  theorem  follows  immediately. 

Theorem  5.24.    Let  t  G  (F^)-^  be  a  doubly-F-astic  template  with  t^(x)  G  F  Jor  all 

X  G  X,  ajid  W  a  configuration  Junction.    Then  t  has  a  weak  local  decomposition  ij  and  only 

iJG{W)  is  strongly  connected.    Furthermore,  there  is  at  most  one  weak  operation  oJ\/. 

The  use  of  this  theorem  is  made  clear  by  the  following  discussion.  Suppose  a  lattice 
transform  t  is  to  be  mapped  to  a  parallel  architecture  thiough  a  decomposition  technique, 
whereby 


t   =   Ca  r:   V   M 
i=i  j=i 

Applying  the  transform  t  to  an  image  a,  we  have 


a  M  t    =  a 


M     Tj      V       M     S: 

i=i  ;=i    ' 


a  M   [Mr; 
i=i 


a  M  [  M  Sj 
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=    [(    •  ■  •   (  (  a  M  Ti  )  0  r.  )   •  •  •    )  M  Th  J  V    [(   ■     •   (  (  a  M  Sj  )  M  So  )   •  •  •   )  M  s^  J. 
Every  r,,  Sj  is  local  with  respect  to  the  network  ol'  processors  and  hence  directly  implement- 
able  on  the  parallel  architecture.   The  one  operation  of  maximum  is  related  to  storage. 
When  computing  the  transform  a  0  t,  the  image    (  •  •  •  ( ( a  M  Tj  )  M  r.,)  •  •  ■  )  M  r,,    must 
be  computed,  the  result  stored,  the  image    (  •■•  ((aMsjMs^)  •■  )  M  8,^    computed, 
and  then  the  maximum  between  the  two  results  taken.   Most  processing  elements  in  parallel 
architectures  have  a  small  amount  of  local  memory  available.   If  they  do  not,  then  the  host 
machine,  or  another  computer  which  is  able  to  communicate  with  the  parallel  one,  must 
store  the  results  separately  then  return  both  to  the  parallel  machine  to  compute  the  last 
pointwise  maximum.   Thus  the  one  operation  of  maximum  is  not  an  unreasonable  stipulation 
in  a  decomposition. 

5.3.    .Applications  to  Rertangulnr  Templates 
A  special  class  of  templates  within  the  invariant  ones  are  rectangular  templates.   Let 
X  C  Z-,  IXl  =  m,  I  Y|  =  n.   Then  a  reclangular  template  t  G  (F^)-^  has  a  rectangular 
array  for  its  support  (away  from  the  boundary  of  X).   Specifically,  S_^{ty)  is  a  rectangle,  for 
some  y  G  X  such  that  S_^{ty)  H  SK  =  0,  where  SK  =  {(i,j)  :  i  =0  or 
m  — 1  ,or  j  =0  or  n  —  1  }.    We  will  use  the  fact  that  invariant  templates  correspond  to 
matrices  that  are  block  toeplitz  with  toeplitz  blocks  [32).   First,  we  derive  the  results  in 
matrix  notation,  and  use  the  isomorphism  to  maj)  the  theorems  to  image  algebra  notation. 
We  give  conditions  under  which  rectangular  templates  can  be  decomposed  into  the  product 
of  two  strip  templates,  one  vertical  and  one  horizontal.   Since  the  proof  of  this  theorem  is 
constructive,  a  decompasition  is  given.   This  theorem  was  presented  in  its  original  form  by  Li 
[60]. 
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5.3.1.    Deoomposirion  of  hinrk  tnepWt-/.  mnfricps 

This  section  presents  results  on  a  decomposition  technique  for  block  toeplitz  matrices 
with  toeplitz  blocks.   Matrices  that  are  block  toeplitz  with  toeplitz  blocks  correspond  to 
invariant  templates.   Conditions  are  given  to  guarantee  a  decomposition  of  such  matrices 
into  a  product  of  two  matrices,  each  of  which  correspond  to  a  strip  template  in  the  image 
algebra.    Strip  templates  are  templates  whose  supports  are  a  1  x  k  array  (horizontal),  or  a  k 
X  1  array  (vertical).   Even  though  these  decompositions  may  not  be  local  ones,  a  decomposi- 
tion of  this  type  will  reduce  the  number  of  computations  per  pixel  necessary  to  compute  the 
transform,  on  either  a  parallel  or  sequential  machine.   As  an  example,  suppose  r  €  (F-^)-'^'  is 
a  rectangular  template  and  has  a  h  x  k  support.   Suppose  there  exists  two  templates  t  and  s 
such  that  r  =  s  M  t,  where  t  is  a  rectangular  template  with  a  h  x  1  support  and  s  is  a  rec- 
tangular template  with  a  1  x  k  support.   Then  for  a  G  F^  and  using  the  associative  property 
of  the  M  operation,  we  have 

aMr=a|2l(sMt)   =(aEas)Mt. 
Computing  a  ©  r  directly  involves  finding  the  maximum  of  hk  additions,  while  computing 
(  a  M  s  )  M  t  involves  finding  the  maximum  of  h  -I-  k  additions.  Thus  savings  in  computar 
tion  can  be  realized  on  sequential  as  well  as  parallel  processors. 

Minimax  matrix  results  We  shall  first  prove  the  following  lemma. 

Lemma  5.31.  Suppose  that  s  €  >(„„  is  a  diagonal  matrix  of  form  s  —  diag(Q',  ...,a),  where 
Of  e  F.    Then  for  t  €  A1„„,  s  X  t  =  t  X  s. 

Proof:   Let  r  =  s  X  t,  and  w  =  t  X  s.    Then 


V   s,,  X   t,j    =   Sij  X   tjj 


and 
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w.j  =  V^  tjk  X  s^j    =   tji  X  Sij . 
Since  1^  =  tjj  =  a\/  ij  =  l,...,n,  we  have 

r-.  =  Sij  X  tjj  =  Sjj  X  tii  =  tii  X  Sij  =  Wij . 

Q.E.D. 

Lemma  5.32.    Suppose  s,t  G  M„„  are  each  block  toeplitz  with  toeplitz  blocks.    Denote  s 
and  t  by 

'   ^1 


7^" 


^h 


Suppose  a  andt  satisfy  the  following  conditions: 

(1)  n  =  hk,  and  each  block  cHJ,  /J  is  a  k  x  k  matrix; 

(2)  there  exist  2h-l  constants  Xjj  such  that  /^  =diag(Xij,  .  .  .  ,Xij)  and  the  matrix 
A  =  ( Xjj )  G  Mjijj  is  toeplitz; 

..    _    I  *^k  i5<^j 

(3)  (yj    =    I     a  6  M  i  =  i'  ^'^^^^^  *k  denotes  the  null  matrix  of  size  k  x  k,  and  a  is  a  toe- 
plitz matrix  where  ajj  G  F; 

//■(I)  -  (3)  are  satisfied,  then  s  X  t  =t  X  s  and  is  of  form 


a'' XT''    a^'xr'- 
cr'-x  r'   cr'-x  -r- 


^h^^i 


a''x  T' 
cr'-x  r 


(^'''X  rh'' 


Proof:  Let  u  =  s  X  t,  and  denote  the  matrix  u  =  ( Ujj )  in  block  notation  by 
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The 


"ij    =     V    Si„,  +  t,„|,  . 
m=l 

For  i,k  G  Z"*"  and  using  the  division  aigoritlini  for  integers,  we  have 

i    =   k  •  pj  +  Tj      for  some  0  <  p|  <  h  and  0  <  Tj  <  k  —  1 . 
If  r;  =  0  then  write  i   =  k  ■  ( Pj  —  1 )  +  k,  where  0  <  p,  <  h  —  1.   Thus,  (abusing  nota- 
tion) in  this  case,  we  can  always  write 

i   =  k  •  Pi  +  Tj      for  some  0  <  p;  <  h  —  1,  and  0  <  T;  <  k  . 
Similarly,  we  have 

j    =  k  ■  Pj  +  Tj      for  some  0  <  pj  <  h  —  1,  and  0  <  Tj  <  k  . 
The  element  u^  lies  in  the  ( p;  + 1 ,  pj  + 1  )-lh  block  of  u,  and  is  the  ( rj ,  rj  )-th  entry  in 
that  block.   The  matrix  s  has  values  of  — oo  when  m  indexes  outside  the  block 
(/'  +  ^'P'+\  i.e., 

Sjn,   =   —OO  for  values  of  m  not  in  {w;i—rj+l  <w<i—ri+k}. 

i-rj+k 

Thus,  Ujj  =    ^y      Sj^  +  t„,j.   Since  the  values  s,,,^,  i-Tj +  1  <m<i-ri +k,  lie  on 

the  rpth  row  of  block  </'      ''''     ,  and  the  values  t„,j  lie  on  the  rj-th  column  of  block 
V  '      '  J     ,  the  value  Uy  can  be  represented  by 

This  is  true  for  any  value  of  Uy  such  that  Ujj  lies  in  block  ^/'""^  '^^'^  ,  i.e.. 


131 

Thus  we  have 

^l  +  l.Pi+l     y.       ^'l  +  l.Tj  +  l         ^  Pl  +  l,Pj  +  l 

Since  ij  were  arbitrary,  Ibis  relation  holds  for  each  value  1  <  p.  +  l ,  Pj+l  <  h. 
That  is, 

t/'x  T^^    =  /f'J  ,   Vi,j  =1 n. 

To  show  commutativity  of  the  product,  we  note  that  for  all  i,j,  c^'  is  toeplitz  with 
finite  elements  on  the  diagonal,  and  the  block  /'  is  a  diagonal  matrix  with  a  constant 
value  on  its  diagonal.   Thus,  we  have  by  Lemma  5.31,  for  all  i,j, 

(yi  X  T^j  =  T^J  X  cy' . 

Let  w  =t  X  s,  w  =  ( (JJ)  in  block  notation,  i,j  =  l,...,h.   We  show  that 

(Ji  =/i  X  a".   Here,  Wjj  =    V  tj,n  X  s„^-    As  before  and  using  the  same  method  and 

ni=l 

notation,  we  have  the  same  restrictions  on  the  indices  of  s^:: 

s„^j    =   — CO  for  values  of  m  not  in  {w  :j  — rj  +  1  <w<j  — rj+k}, 
and  the  values  s,„j  for  j  -r^  +  1  <m  <j  -rj  +  k  lie  on  the  Tj-th  column  of  the  block 
(/^     '^'    .   Similarly,  the  values  t-^^  for  j  -rj  +  1  <m  <j  -rj  +k  lie  on  the  r^-th  row  of 
block  /''+"Pi+\  i.e., 

and  thus  in  general  we  have 

/j  X  crJJ    =    (Ji . 

Since  (f'  =(7'^  for  all  i,j,  we  have 

Jj    =   T^J  X  crJJ    =    fi  X  o"'    =   &'  X   f'    =   IJ''^ . 

Q.E.D. 
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Let  us  define  a  strip  malrix  s  G  M„„  if  *~^(s)  is  a  strip  template.   A  vertical  siT\\) 
matrix  t  G  Al^^,  n  =  hk,  is  a  matrix  whicli  is  block  toeplitz  with  toeplitz  blocks,  t  =  (/J), 
each  /Ms  k  X  k,  i,j  =  l,...,h,  and  f^  —  diag(Q'jj,  .  .  .  ,0^ )  for  some  q-jj  G  F_^.   Since  f^  = 
^i,j-i+i  if  j  >  i  and  f^  =  r'~J+i'*  if  i  >  j,  there  arc  actually  only  2h-l  constants  Q'jj  which  deter- 
mine the  fK   Denote  these  constants  by  a^  ,  Qjj  ,  a^  ,  i,j  =  2,...,h,  where 

diag(Qii,  .  .  .  ,Qii)      ifi^j 
7^J   =   •      diag(aij,  .  .  .  ,Qjj)      if  j  >  i    . 
diag(a;i,...,aii)      if  i  >  J 

Also,  we  must  have  Q'jj  G  F  for  j  =l,2,..,mi  and  cvu  G  F  for  j  =l,2,..,mo,  for  some  1  <  mj, 
m2  <  h.    Vertical  strip  matrices  correspond  to  vertical  strip  templates. 

A  horizontal  strip  matrix  s  G  M„„,  n  =  hk,  is  a  matrix  which  is  block  toeplitz  with  toe- 


*. 


i^^j 


plitz  blocks,  s  =(o"),  each  (yj  is  k  x  k,  i,j  =  l,...,h,  and  (f'=\         ^  .,  .,  where  4>t 

denotes  the  null  matrix  of  size  k  x  k,  and  a,  is  a  toeplitz  matrix  where  ajj  G  F.   Horizontal 
strip  matrices  correspond  to  horizontal  strip  temjjlates.   Note  that  such  a  matrix  is  a  diago- 
nal block  toeplitz  matrix  with  toeplitz  blocks,  that  is,  the  only  non-null  block  is  the  diagonal 
block. 

We  are  now  in  a  position  to  prove  the  main  result  of  this  section. 

Theorem  5.33.    Assume  u  G  A{„„,  ?i  =  hk,  is  block  toeplitz  with  toeplitz  blocks,  and  write 


.  //hi 

ti'here  each  fi'^  is  a  k  x  k  subinatrix  and  (/i")nim  7^  ~°°  V  i,m.     Then  u  is  decomposable  into 
two  strip  matrices,  one  horizontal  a  and  one  vertical  t,  if  and  only  if 
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(1)3  2h-l  constants  Xjj,  X^j,  i,j  —  l,...,h  with  \^  =  0,  such  that  A  =  (Xjj)  G  M^h  is  toeplitz 
and  of  form 

0     \,    .    .    \ 

0     .    .      . 

A   =  

\i    \->   ■    ■     0 

(2)  the  constants  Xjj  satisfy  Xy  X  /<"    =  //'■'  for  all  ij  =  l,...,k. 

In  this  case  a  decomposition  is  given  by  the  folloiuiny  matrices  which  are  each  block  toeplitz 
with  toeplitz  blocks: 


■  all 

ai" 

t  = 


^h 


where  each  oj  c^\  /■'  are  k  x  k  matrices  and  satisfy: 


T^j    =   diag(Xij,  ...,Xi^);        cyi 


*. 


ir^j 


/^■eMhh    i=J 


Here,  X^  =0,  and\  =  Uy  X  (un)  i,  X^  =  Uji  X  (uj-i,  i,j  =2,...,h. 

Proof:  Suppose  (1)  and  (2)  are  satisfied.   We  show  that  ibr  s  and  t  as  in  the  statement  of 
the  theorem,  s  X  t  =  u.   Let  w  =  s  X  t.   By  Lemma  5.32,  w  has  form 


o'-hxr^'i 


Choose  an  element  W;:.   As  in  Lemma  5.32, 


o^^xr"' 
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i   =   k  ■  Pi  +  Ti      for  some  0  <  P|  <  h  —  1,  and  0  <  Fj  <  k  . 
j    =  k  ■  Pj  +  Tj      for  some  0  <  Pj  <  li  —  1 ,  and  0  <  Tj  <  k  . 
and  the  pair  (i,j)  lies  in  the  block  (p;  +  1,  Pj  +  1 ).   Thus, 

i-i'i  +  k 

y    Ui„^  +  t,^j . 

m=i-r|  +  l 

Since  r'     '  '      =diag(Xp^^j  ^j,  .  .  .  ,Xp|+i,p.+i),  t'le  only  possible  non-null  element 
of  {t„^j  :  i— rj  +  1  <  i  — Tj  +k  }  lies  on  the  diagonal  of  r'*'     '^^     ,  and,  in  fact,  lies  in 
the  (rj,rj)-th  position  in  /^     '^''     .   The  (rj,rj)-th  position  in  t'''"'"  '''^      is  in  the 
(i,i— ri-|-rj)-th  position  in  u.   So 

■^ij     =    "^i.i-ri  +  fj  ^    \,+l,Pj+l- 

By  (1)  we  know  that 

\  V   ,,Pi  +  i'Pi  +  l    _    „Pi  +  l'Pj  +  l 

'^Pi+i.Pj+i  ^  M  —   /* 

which  implies  that 


(Vi,,.i).X(M^'"''''/^    =(M^'"''^^"' 


which  implies 


But 


Therefore, 


Pj+Wr,  -    \t-  J       —    Kt^  ;ri,rj     —    ^ij 


Vi.Pj+iX(/'''^''''^)n,,  =  "ij- 


•'  /r|,rj  '■'i,i-i-,  +  rj- 


Now  suppose  that  u  is  decomposable  into  two  strip  matrices,  a  horizontal  one  s  and 
a  vertical  one  t.  We  show  that  s  and  t  satisfy  conditions  (1)  -  (3).  By  the  definition 
of  a  vertical  strip  matrix,  we  see  that  t  is  block  toeplitz  with  toeplitz  blocks,  and 
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t  =  r'-'  is  of  form 


T^J     = 


diag(Q'ii,  .  .  .  ,Qii)  ifi^j 
diag(Qjj,  .  .  .  ,Q]j)  if  j  >  i 
diag(Qij,...,Qii)      in>j 


for  some  2h-l  constants  d'u  ,Qii  .Q'lj ,  i,j  ='2,..,,h.   Set  cvu  =0,  Ojj  =  Ujj  X  (uii)~\ 


«ii  =  "ii  X  ( u,  )-i.   Define  A  =  ( X^j )  G  Al,,,,  '^.V  \j 


o^ii      if  i  =  j 

Qji       if  j  <  i.   Then  A  is 


if  i  <  j 


toeplitz,  with  the  2h-l  constants  X^j ,  Xj, ,  \-^ ,  i,j  =  2,...,h,  satisfying  condition  (1). 
Also,  8  is  a  horizontal  strip  matrix,  which  means  that  (using  block  notation) 
s  =((/■'),  where 


0^j 


<^. 


i?^j 


and  a  is  toeplitz  with  non-null  diagonal  entries.  Set  a  =  //',  The  last  thing  we  need 
to  show  is  that  condition  (2)  is  satisfied.  By  Lemma  5.32,  the  (i,j)-th  block  of  s  X  t 
is  of  form 

<y'  X    T^J  , 

and  since  f'  is  diagonal,  cH'  X  fi  =  /ix  a^'.   So,  t"^  X  o"'  =  diag(ajj ...,  a-- )  x  fl'  = 
Xjj  X  fi"  =  //'j.   Obviously,  s  X  t  =  u,  and  this  completes  the  proof. 

Q.E.D. 
The  statement  in  the  image  algebra  of  Theorem  5.33  is 
Theorem  5.34  [60].    Let  r  E  (R^,)-^  be  a  rectangular  template  with  noti-?iull  weights 
^xl'^j):  '  =  l,...,m,  j  =  l,...,k.    Then  r  has  a  decomposition  into  two  strip  templates,  one  hor- 
izontal and  one  vertical,  if  and  only  if  for  all  1  <  i,i'  <  m  and  1  <  j,j'  <  k, 


CHAPTER  6 
THE  DIVISION  ALGORITHM 


fij — A  Division  Algorithm  in  a  Nnn-Eiirlidp3,n  Domain 

The  integers  have  the  property  that  a  division  algorithm  can  be  defined  on  them.   For 
a,b  G  Z,  there  exist  unique  integers  q,r  such  that  a  =  qb  +  r  where  I  r|  <  I  b|.    This  is  an 
example  of  an  integral  domain  upon  which  is  defined  a  Euclidean  valuation  [61].   In  this  sec- 
tion we  present  a  division  algorithm  for  the  minimax  algebra  structure,  and  give  an  applica- 
tion of  this  result  to  image  processing  in  the  image  algebra  notation. 

We  remark  that  the  boolean  case  has  already  been  stated  by  P.  Miller  [62],  and  will  be 
discussed  in  more  detail  at  the  end  of  this  section. 

6.1.1.    A  Matrix  Division  Algorithm 

Let  E^  =  F_^  be  a  sub-bounded  1-group  of  R_<^.   For  notational  convenience,  we  will 
write  t  E  M„jj(-oo)  when  we  mean  that  the  matrix  t  will  assume  values  only  on  F  U  {-oo}. 
Similarly,  we  write  t  G  Alnn(+~)  when  the  matrix  t  assumes  values  only  on  F  U  {+oo}.   We 
will  show  that  for  a  finite  vector  a  G  F"  and  a  subset  of  matrices  of  H^J^-cx),  that  there  exist 
vectors  q  and  r  £  F  "°°  such  that 

a  =  (  t'  X  q  )  V  r 
Lemma  6.1.    Let  a  G  F"  6e  finite,  andt  G  Mn„(-co)  satisfy  S^^{t{)  7^  0V  i  =  l,...,n. 

Define  tbyt={t  )'.    Then  both  t  X'a  and  t'  X  (t  x'a)  are  finite,  and 

t'X  (t  x'a)  <a. 
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Proof:  First  we  note  that 

f      -ty.     if  tij   G  F 

(t),    =   [(t*)'],    =(t*),,    =i,,r    =    |+oo:ft,=-oo 
and  that  S^J^i^ )  =  S^^{t^).   Let  b  =  t  x'  a  and  let  c  =  t'  X  b.   At  location  i, 
b;  =        A        tji  +  a:.   The  vector  b  is  finite,  as  lor  i  G  |l,2,...,n|,  there  exists  at 

least  one  j  G  ^+^(ti)  such  that  tjj  +  aj  is  finite,  since  by  hypothesis,  5_<^(ti)  7^  0  V  i 
=  l,...,n,  and  a,  G  F  V  i  =  l,...,n  also.   Thus,  b,  =^  J        A       t:|  +  a:  Ig  F  V  i.   At 

location  i,  Cj  =        V        t'jj  +  bj.    By  a  similar  argument,  we  see  that  Cj  G  F  V  i. 

Suppose  that  c,  =  t\^.  +  \  for  some  k  G  {l,2,...,n}.   Then  bj.  =       A       L-  +  &■  = 

t,jp  +  a^  for  some  p.   Since  k  G  S_^{t\),  we  know  that  i  G  $__^{t^.).   Since  5_oo(t^)  = 
'^+oo(*k)>  we  know  that  i  ES_^J(i^),  and,  hence 

tkp  +  S   <  h\  +  a;  G  F  , 
by  our  choice  of  p  and  the  fact  that  t,^;  G  F  and  aj  G  F  V  i.   Thus 

Ci  =  t ik  +h=  t'ik  +  t,,p  +  ap  <  t'i,  +  t^i  +  ai  =  t^i  +  ( -tki )  +  ai  =  a^ 
Thus,  Cj  <  aj,  and  our  lemma  is  proved. 

Q.E.D. 
We  now  state  the  Division  Algorithm. 

Theorem  6.2.  The  Division  Algorithm.    Let  a,  t  sathfij  the  hypothesis  of  Lemma  6.1. 
Then  for  q  =  t  X'  a,  and  r  defined  by 


aj     if  aj  >  [t'x  (t  X'a)]j 
-t^'     if  aj  =  [t'x  (t  X'a)]j 
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we  have 

a  =  (  t'  X  q  )  V  r 
Proof:  By  Lemma  6.1,  a  >t'X  q  =  t' X  (t  x' a),  and  hence, 

a  >  r. 

Thus,  [t'  X  (t  X'  a)]  V  r  <  a.   To  show  that  equality  holds,  that  is,  that 
[t'x  (tX'a)]Vr=a,  we  examine  two  cases. 

Case  1.    aj  >  [t'X  (t  x'a)];.   Here,  [t'x  (t  x'a)],  V  Fj  =  [t'x  (t  x'a)],  V  aj  = 
^■ 

Case  2.    a^  =  [t'x  (t  x'a)];.    Here,  [t'x  (t  x'a));  V  F;  =  aj  V  r^  =  a^  V -oo  =  a;. 

Q.E.D. 
Now  suppose  we  have  a  =  (  t'  X  q  )  V  r  for  a  finite,  t  E  M„^{-<x,)  and  t  satisfying 
S_^(ti)7^0Vi  =  l,...,n.   Define 

a"  =  a 
r'^  =  r,  and 
a'  =t  X'a'-^ 
Then  we  have 

a  =  a"=(t'x  aM  Vr"  (6-1) 

By  Lemma  6.1,  a^  =  t  X'  a''  is  finite,  and,  in  fact,  a'  =  t  x'  a'~^  will  be  finite  for  each  i  = 
1,2,...   Thus,  the  Division  Algorithm  applies  in  particular  to  a': 

ai  =  (  t'  X  a-  )  V  r^  (6-2) 

and  substituting  (6-2)  into  (6-1),  we  get 

a  =  (  t'  X  a'  )   V   rO 
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=  {t'X  [(t'X  a-)   V  r^  j  }   V   Tu 
=  (  t'  X  t'  X  a-  )   V  (  t'  X  r^  )   V  r"^ 

=  [(t')-X  a-]    V   (t'X  rM   V   r"  (6-3) 

k 
where  (t')''  denotes  the  k-folcl  product  of  t,  X   (t'). 

i=i 

Apply  the  Division  Algorithm  to  a",  to  get 

a-  =  (  t'  X  a^  )   V   r- 
and  substituting  this  into  (6-3),  we  get 

a  =  {  (t')-  X  [(  t'  X  a'^  )   V   r-]  }   V   (  t'  X  r'  )   V  r» 

=  [(t')-X  t'X  a'^]    V   [(t')-X  r-j    V   [t'X  r']    V  r" 

=  [{t'fxa.^]    V   [(t')-X  r-^j    V    [t'X  ri|    V   r" 

We  can  continue  like  this  up  to  any  k-th  iteration. 

a  =  r»   V    [t'X  r'[    V    [(t')-X  r"^]    V     ■••     V    {{t'fx  r^]    V    [(t')''+i  X  b}'+'^] 
or,  if  we  let  (t')"  denote  the  identity  matrix  e,  we  have 

a=  ^  [(t')'X  r'l    V   [(t')*^+ix  a}+^] 

i=l 

We  now  state  a  result  which  will  be  useful  in  describing  the  division  algorithm  in  the 
image  algebra. 

Lemma  6.3.    Let  a,b  G  F"  (be  finite  vectors).    Then  we  may  express  the  difference  of  vec- 
tors a  andh,  a  -  b,  using  the  following  matrix  transform.    Define  s  G  H^J^-oc)  by 
s  =diag((bi)  .•••,(bn)*)  =  diag( -bi,...,-bj  with  -b,  denoting  the  real  arithmetic  additive 
inverse  of  the  real  number  bj.    Then 

s  X  a  =  c    e  F",     where 
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c,  =  aj  —  b|,     i  =  l,...,n  , 


Proof: 


(s  X  a)i  =  V^  (Sii,  +  aj  =  s;i  =  a^  =  -bj  +  a, 
for  i  =  l,....,n. 

Q.E.D. 
We  remark  that  the  vector  r  as  defined  in  Theorem  6.2  can  be  obtained  in  the  follow- 
ing way.   Fix  a  6  F",  finite.   Define  f,.  :  F"  — ►  F"  bv 


Li^)  =  y   where  y,    = 


0     ''"  ^i  >  Xj 
-oo    otherwise' 


Then  for  x  =  t'  X  (t  x'a),  (J^x)  =  ' 


0     if  aj  >  [t'x  (t  X'a)]i 
-oo     if  a;  <  [t'x  (tx'a)]i 


However,  it 


easily  shown  that  f^  is  not  an  s-lattice  homomorphism.   For  example,  choose  n  =  2,  a,  d,  and 
e  as  below: 


Thenf„(dVe)=f„ 


3 
-1 


,     d  = 


0 


,  but  fjd)  V  fje)  - 


0 
0 

V 

-oo 

0 

= 

0 
0 

^fa(dVe). 


Thus,  according  to  Theorem  3.1,  f„  cannot  be  represented  as  a  matrix  transform.   If, 
however,  we  go  outside  of  the  structure  of  the  mininiax  algebra,  and  use  image  algebra 
operations  in  addition  to  V  and  M  (or  ©),  we  can  express  this  transform  in  a  succinct  way, 
as  will  be  demonstrated  in  the  next  section. 
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A  dual  division  algorithm  Tiie  duality  of  the  operations  of  the  matrix  algebra  enable  us 
to  describe  a  dual  division  algorithm.   We  omit  the  proofs,  as  they  are  the  dual  of  the  proofs 
given  in  the  previous  section. 

Lemma  6.4.  Let  a  G  F"  6e  finite,  and  t  G  >(„„(+«)  satisfy  S^Jt-^  ^0y[  =  l,...,n.    Define 
t  by  t  =  ( t* )'.    Then  both  t'  X  a  and  t  X '  ( t'  X  a.)  are  finite,  and 

t  x'(t'X  a)  >a 
Lemma  6.5.    (The  Dual  Division  Algorithm)    Let  a,t  satisfy  the  hypothesis  of  Lemma 
6.4.    Then  for  q  =  t'  X  a,  and  r  defined  by 


a;     if  aj  <  [t  X'(t'x  a)]; 
+  0O    if  a;  =  jtX'(t'x  a)]i 


we  have 

a=(t  X'q)  Ar. 

6.2.    .An  fmngp  Algebra  Division  Algorithm 

Using  the  isomorphism  *,  we  can  express  these  ideas  in  the  image  algebra.   Let 
t=(t*)'fortG(F_>L)^: 

Lemma  6.6.   Let  a  G  F^,  t  G  {F^J^  be  such  that  5^,^(tJ  ?^  0  V  x  G  X.    Then  each  of 
a  Q  t  and  {a.  El  t)  M  t'  are  finite,  and  a.  >  (a  |Z3  t)  M  t'. 
This  next  theorem  is  the  counterpart  to  Lemma  6.3. 

Lemma  6.7.  Let  a,b  G  F'  .    Then  the  image  c  =  a  -  b  may  be  expressed  using  a  template 
in  the  following  way.    Define  s  G  (F^^)-^  by 
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-b(y)     ifx  =y 
s..(x)  =1  ^,         .     . 

^^  '       [      —  oo    otherwise 

Then  a  M  s  =  a  —  b. 

Using  the  lattice  characteristic  function,  it  is  sometimes  the  case  that  we  can  stay 
within  the  lattice  operations  of  V  and  M  and  the  image  algebra  operation  of  +  when  needing 
to  express  a  characteristic  function.   An  example  of  this  follows  immediately. 

Theorem  6.8.  The  Division  Algorithm.    Let  a,,  t  satisfy  the  hypothesis  of  Lemma  6.6. 
Then  /or  q  =  a  E3  t  aiid  r  defined  by 

r=a  +  x~o(a)[a-((a  0  t)  M  t')] 
we  have  that 

a   =  (  q  0  t' )    V  r  . 
Proof:  We  need  to  show  that  *~^(r)  matches  with  our  definition  of  the  matrix  r  in 

Theorem  6.2.   Let  b  =  (a  IZ3  t)  M  t'.   Then  using  Lemma  6.7,  a  -  b  =  a  0  s, 
where 

,  ,       /-My)     ifx=y 
^^  '       [      —OQ    otherwise 

Thus,  a  -  b  >  0  implies  that  a  M  s  >  0.    Now, 

X?.(»ns)=ceF'=,     „l,e,.e       cW  =  |       "     'If'  >''">'- 

^  '       [-00    ifa(x)=b(x) 

Thus,  at  location  x  G  X,  the  image  r  =  a  +  \>o[a  M  sj  has  the  gray  value 


r(x)  =  a{x)  +  c(x)   = 


a(x)  +  0   if  a(x)  >  b(x) 
a(x)  +  —oo  if  a(x)  =  b(x) 


a(x)   if  a(x)  >  b(x) 
—  oo   if  a(x)  =b(x) 


Under  ^,  this  remainder  image  is  the  same  as  the  vector  r  in  Lemma  6.2. 


Q.E.D. 
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Iterating  k  times  on  an  image  a  and  a  template  t  satisfying  the  hypothesis  of  Lemma 
6.6,  we  obtain 

a-  t  [(r'  M  [t'f]   V   [(a''+i  M  (t')'=+'] 
where  any  template  t  raised  to  the  zero-th  power,  t°,  is  the  identity  template,  e. 
In  the  boolean  case,  there  exists  an  integer  m  such  that 

a„EI  (t'r=0 
so  that  the  expression  for  a  becomes 

a   =    'i'   r.  M  (t')'' 
k=o 

One  useful  application  of  this  result  is  in  data  compression.   By  encoding  the  Fj's  in  run 
length  code,  the  image  can  be  represented  by  fewer  bits  of  data,  and  reconstructed  exactly 
once  t  is  known. 

We  have  the  dual  Division  Algorithm  stated  in  the  image  algebra  also. 
Proposition  6.9.    Let  a  G  R^,  t  G  (R^  J^  be  such  that  5_«(tJ  ?^  0  V  x  G  X.    For  t  by 
t  =  (t  )',  we  have  that  each  of  a.  U  t'  a/ui  (a  M  t')  Q  t  are  finite,  and  a  <  (a  M  t')  ES  t. 
Proposition  6.10.    (The  Dual  Division  Algorithm).    Z,e/a,  t  satisfy  the  hypothesis  of 
Proposition  6.9.    Tlien  for  q  =  a  M  t'  and  r  defined  by 

T  =a  Ax<o[a-((a  M  t')  El  t)] 
we  have  that 

a    =   (  q  IZ3  t  )    Ar. 


CHAPTER  7 
TWO  EXAMPLES 


7.1.  An  Onpration.s  Respnirh  Prohlpm  Sfatpd  in  Tmngp  Algebra  Notafinn 

This  section  gives  a  short  description  of  the  Iransportation  problem  in  linear  program- 
ming [63],  and  provides  a  translation  of  the  dual  transportation  problem  into  image  algebra 
notation.   Thus,  this  provides  an  example  of  the  use  of  the  isomorphism  *~^. 

Let  m  producers  and  n  consumers  of  some  commodity  be  given.   Let  Pj  denote  the  pro- 
duction capacity  of  producer  i,  dj  denote  the  demand  of  consumer  j,  and  c-  denote  the  cost  of 
transporting  one  unit  of  commodity  from  producer  i  to  consumer  j.   The  problem  is  to  deter- 
mme  how  much  commodity  to  ship  from  each  producer  to  each  consumer  so  that  consumer 
demands  are  met,  production  capacities  are  not  exceeded,  and  transportation  costs  are 
mmmiized.   This  can  be  formulated  as  a  linear  programming  (LP)  problem,  which  we  state 
as  follows. 

Let  Zjj  be  the  number  of  units  of  commodity  to  be  shipped  from  producer  i  to  consumer 
j.   Then  the  total  transportation  cost 


m     n 

2j  ZjC;;Z 

i=lj=l 


IJ  IJ 


is  to  be  minimized.   To  stay  within  production  capacity,  we  also  must  have 


IjZjj  <  Pi ,  i  —  l,,..,m 
and  to  satisfy  consumer  demands  we  must  have 
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ZjZ::    >  cl:,   j    =  l,...,n. 


Thus  the  LP  problem  is  to 


Minimize  2Jljc:iZii 


Subject  to       — 2jZij>— Pi,       i  =  l,...,m  (7-1) 

m 
,^Zij>dj-  j  =  l,...,n,  and       (7-2) 

Zjj  >  0  for  all  i,j. 

Let  X;  be  the  dual  variable  associated  with  the  i-th  constraint  in  (7-1),  and  y:  the  dual 
variable  associated  with  the  j-th  constraint  in  (7-2).   Then  the  dual  transportation  problem  is 

[63] 

m  n 

Maximize         —  Zj  p:X|  +  I]  d;Vi 
i=i    '  '      j=i   J-^J 

Subject  to  -Xj  +  .Vj  <  Cij  for  all  i,j 

x;  >  0,  .Vj  >  0  for  all  i,j. 

This  is  equivalent  to  solving 

m  n 

Minimize  —  [  —  S  PiX,  +  Z)  chy ;  ] 

Subject  to  -Xj  +  yj  <  Cjj  for  all  i,j 

■^i  >  0,  yj  >  0  for  all  i,j, 

which  is 
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Minimize         zJ  PiX:  —  I]  cliV: 

Subject  to         -Xj  +  yj  <  Cy         for  all  i,j 
Xi  >  0,  .Vj  >  0        for  all  i,j. 
Make  a  change  of  variables  by  letting 

Vj  =  — yj       and  Uj  =  — Xj ,  for  all  i,j . 
Then  we  have  the  equivalent  dual  LP  problem 

n  m 

Minimize  Zj  djVj  —  Zj  PjUj 

Subject  to  U|  -  Vj  <  Cjj  for  all  i,j 

Uj  <  0,  Vj  <  0        for  all  i,j. 

Using  the  theory  of  complementanj  slacks  [63],  if  we  assume  that  the  producers  p;  hi 
value  Pi  >  0  for  all  i,  then  we  can  be  guaranteed  that  for  each  i  =  l,...,m,  there  exists  at 
least  one  j  G  {l,...,n}  such  that 


"i-Vj=Cij- 


and,  hence, 


Ui  =mjn{cij +yj},  (7-3) 

where  u  -=  (ui,..,u,„)  and  v  =  ( Vi,...,vJ  are  optimal  feasible  solutions.   We  can  rewrite  (7-3) 
in  vector  notation,  as 


u  =C  X' 


and  Uj,  Vj  <  0. 


To  formulate  this  problem  in  context  of  the  image  algebra,  we  define  X  and  Y  to  be 
non-empty,  finite  coordinate  sets,  |x|  =  m,  I  Y|  =  n.    Define  d  G  (R^lo)^  by 
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and  define  p  G(R^J^by 


Define  a  6  R^,  b  G  RJ^  by 


dy,(yj)  = 


PxAXi, 


^'i        1  =  J 
-co      otliervvise 


Pi        i=j 


Then  we  have: 


"p  y       [   —oo      otherwise 

a(x|)  =  Uj  (the  variable) 
b(xi)  =  V|  (the  variable) . 


LP  Image  Algebra 


Dd:V:  E(b  M    d) 

j=i   J  J  ' 

m 

ZjpiUj  2j(a  M  p) 


Now,  define  te(R21o)''^  by 

tv/yj)  =  Cij 

We  have  the  equation  u  =  C  x' v  translates  as  a  =  b  0  t.   Thus,  in  image  algebra  nota- 
tion, the  dual  LP  problem  is 

Minimize  XI(bMd)-Z)(aMp) 

Subject  to  a  =  b  El  t 

a  <  0,  b  <  0 
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1:2.    All  Im:vgp  fomplpvify  Measiirp 

This  section  presents  an  image  complexity  measure,  a  term  used  in  image  processing  to 
describe  any  method  which  provides  a  quantitative  measure  of  some  feature  or  set  of  features 
in  an  image.   Image  complexity  measures  are  used  either  as  a  pre-processing  step  in  which 
the  measures  help  direct  the  selection  of  the  next  processing  step,  or  in  conjuction  with  other 
information  derived  from  the  image  to  identify  olijects  of  interest. 

The  measure  investigated  [64]  is  based  on  a  method  discussed  by  Mandelbrot  [65]  for 
curve  length  measurements.   The  original  algorithm  was  modified  and  translated  into  image 
algebra.   The  measure  itself  consists  of  a  graph  which  in  theory  gives  an  indication  of  the 
rate  of  change  of  variation  in  the  gray  level  surface.   The  algorithm  for  computing  the  meas- 
ure is  presented,  followed  by  a  discussion  of  an  application  to  12  outdoor  images. 

The  general  approach  of  the  algorithm  is  to  make  successive  approximations  of  the  area 
of  a  gray  level  surface,  and  then  plot  the  approximations  using  a  log-log  scale.   The  log-log 
scale  is  purported  to  allow  a  better  visual  inspection  of  the  information  contained  in  the 
graph. 

Consider  all  points  with  distance  to  the  gray  level  surface  of  no  more  than  k.   These 
points  form  a  blanket  of  thickness  2k,  and  the  suggested  surface  area  A(k)  of  the  gray  level 
surface  is  the  volume  of  the  blanket  divided  by  2k.   Here  we  have  A(k)  increasing  as  k 
decreases. 

To  begin  the  computation  of  the  surface  area  for  k  =1,2,...,  an  upper  surface  u^  and  a 
lower  surface  b^  are  defined  iteratively  in  the  following  manner.  Let  a  be  the  input  image. 
Let 

"o  =  a,      b„  =  a 

Then  define  u^  and  b|;  for  k  =  1,2,...,  by 
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\  =  bk_i  0  -t 


where 


0 

^     N 

0 

1 

0 

0 

The  volume  v(k)  of  the  "blanket"  between  the  upper  and  lower  surfaces  is  calculated  for 
each  k  by  computing 


Pi(k)  =  u^©s,        q,(k)  =  b,©(-s) 


whe 


0.67 

0.33 

0.33 
\      / 

0.67 

Letvi(k)=i;[pi(k)+qi{k)]. 

This  method  of  estimating  the  volume  was  derived  using  elementary  calculus.   We 
explain  the  method  for  calculating  the  volume  between  the  upper  surface  and  the  coordinate 
set  X.   The  volume  between  the  lower  surface  and  X  is  found  in  a  similar  way.   Given  four 
pixel  locations  in  X,  (ij),  (i,j+l),  (i+l,j),  and  (i+],j+l),  a  box  was  constructed  from  the  eight 
points  in  R-''  corresponding  to  the  four  gray  values  u^(ij),  u,.(i,j+l),  U|.(i+l,j),  U|^(i+l,j+l), 
and  the  four  given  pi.xels.    Drawing  a  line  from  u^(i,j)  to  0^(1+1  J+l)  and  a  line  from  (iJ)  to 
(i+l,j+l),  the  volume  of  the  triangular  column  determined  by  the  six  points 
"k(ij)-  Uk(i+lJ)>  Uk('+lJ+l)'  (iJ).  (i+lJ),  and  (i+lj+l)  was  found  using  elementary 
methods  from  calculus.   Similarly,  the  volume  of  the  triangular  column  determined  by  the  six 
points  U|,(i,j),  Uk(i,j+1),  u^li+lj+l),  (i,j),  (i,j+l),  and  (i+lj+l)  was  determined.   The  volume 
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of  the  two  pieces  are  added  together  to  give  an  estimate  to  the  volume  of  the  box  determined 
by  the  eight  initial  points.   This  is  done  over  the  entire  coordinate  set  X,  and  all  volumes 
added  together  to  give  an  estimate  of  the  volume  between  X  and  the  gray  value  surface  u^. 
The  method  was  expressed  using  the  image  algebra  operation  ©  and  an  invariant  template, 
omitting  the  boundary  effects.   Using  this  approach,  the  volume  is  overestimated,  so  it  is 
corrected  by  applying  a  variant  template  w  efl'ective  only  on  the  edge  pixels.   Define  w  by 


0.33 


0.67 


if  X  is  a  top  edge  pixel  and  not  the  top  right  corner  pixel. 


0.33 


if  X  is  the  top  right  corner  pixel, 


0.67 


P ^ 

0.33 

:^ A 


if  X  is  a  right  edge  pixel  but  not  the  top  right  corner  pixel,  and  w^  =  0,  if  x  is  otherwise. 
To  correct  for  the  extra  volume  added  in  on  the  edge  pixels,  we  calculate 
p.,(k)  =  u^  ©  (-w),       q.3(k)  =  bk  ©  w 
and  let  volerr(k)  =  E  [p2(k)  +  qo(k)].   The  correct  volume  v(k)  is 

v(k)  =Vi(k)+volerr(k). 
The  approximated  surface  area  is 

area(k)  =  -^. 
^  ^        2k 

The  rate  of  change  of  log(area(k))  with  respect  to  log(k)  contains  important  information 
about  the  image.   The  slope  S(k)  of  area(k)  versus  k  is  computed  on  a  log-log  scale  for  each  k 


151 

by  finding  the  best  fitting  straight  line  through  the  thi'ee  points 

(log(k-l),  log(ai-ea(k-i))),    (iog(l<),  log(area(lc))),    (log(k+l),  log(area(k+l))). 
The  graph  of  S(k)  versus  k  is  called  the  signature  of  the  image.   We  can  also  calculate  a 
signature  for  the  case  where  the  array  X  represents  the  bottom  surface  and  u,;  the  upper 
surface.   We  call  this  the  upper  signature.   Similarly,  the  signature  which  is  calculated  using 
{b|j }  for  the  lower  surfaces  and  X  for  the  upper  surfaces  is  called  thelower  signature. 

This  algorithm  was  run  on  12  images.   For  each  image,  we  calculated  the  input  image, 
Uj,  bj,  i  =  1,...,50,  and  the  graph  of  the  upper  and  lower  signatures. 

As  k  increases,  regions  of  pixels  initially  having  the  highest  gray  values  decrease  in  size 
in  the  images  h^.   However,  as  k  increases,  the  images  u,.  shrink  regions  having  lower  gray 
values.   In  theory,  this  asymmetry  can  be  taken  advantage  of   Roughly,  the  lower  signature 
represents  the  shape  of  objects  with  high  gray  values,  and  the  upper  signature  represents  the 
distribution  of  objects  throughout  the  image.   The  images  to  which  we  applied  this  method 
were  infrared,  so  we  were  mainly  interested  in  the  lower  signatures. 

The  magnitude  of  the  curve  S(k)  is  related  to  the  information  lost  on  objects  with 
details  less  than  k  in  size.   The  more  gray  level  variation  at  distance  k,  the  higher  the  values 
for  S(k).   Thus,  if  at  small  k  S(k)  is  large,  then  there  is  "high-frequency"  gray  level  variations, 
and  if  at  large  k  S(k)  is  large,  then  we  have  "low-frequency"  gray  level  variations.   The  curve 
S(k)  thus  gives  us  information  about  the  rate  of  change  of  variations  in  the  gray  level  surface. 

After  running  the  program  on  a  dozen  images,  we  have  concluded  that  this  algorithm  is 
too  sensitive  to  the  great  variance  in  outdoor  sceneiy.    For  example,  an  image  which  has  a 
background  of  trees  and  no  targets,  and  an  image  which  has  two  distinct  targets  and  no  trees 
as  background  have  similar  graphs  for  the  lower  signatures.   While  the  lower  signature 
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represents  more  of  the  shape  of  the  hot  objects  (areas  with  high  gray  values)  in  the  image,  in 
one  image  we  have  no  hot  objects  while  in  the  other,  there  are  two  distinct  hot  objects.   As 
another  example,  in  two  other  images  we  have  a  target  with  a  road  and  a  field  as  back- 
ground, yet  the  graphs  for  the  upper  signatures  for  these  images  have  a  very  distinct 
difference.   The  theory  suggests  that  upper  signatures  should  represent  similar  targets,  but 
we  cannot  draw  that  conclusion  from  this  data.   The  examples  given  in  the  original  paper 
[64]  are  of  a  very  regular  texture  and  are  presented  in  a  controlled  environment.   It  is  very 
likely  that  the  controlled  environment  in  which  the  data  was  taken  is  one  reason  why  this 
algorithm  was  successful  for  those  authors. 

The  initial  goal  of  investigating  this  type  of  complexity  measure  was  that  these  graphs 
would  hopefully  give  a  measure  of  gray  level  variation  within  an  image  and  help  in  choosing 
a  more  effective  edge  operator.   If  an  image  has  a  high  incidence  of  gray  level  variation  at 
small  values  of  k,  then  it  is  reasonable  to  assume  a  more  sensitive  mask,  such  as  the  gradient 
mask,  would  give  better  results.   Otherwise,  if  an  image  had  small  values  of  S(k)  at  small 
values  of  k,  then  computation  time  could  be  saved  by  using  a  Sobel  operator  instead  of  a 
computationally  intensive  edge  operator  such  as  the  Kirsch.    Unfortunately,  the  algorithm 
did  not  produce  data  that  leads  to  this  conclusion. 


CONCLUSIONS  AND  SUGGESTIONS  FOR  FURTHER  RESEARCH 

We  have  shown  that  the  establishment  of  an  isomorphism  between  a  lattice-based 
matrix  theory  and  the  image  algebra  provides  a  powerful  tool  in  image  processing  which  was 
not  available  previous  to  this  research.   Just  as  linear  transforms  are  able  to  be  represented 
as  matrices  within  the  structure  of  linear  algebra,  lattice  transforms  are  able  to  be 
represented  as  matrices  within  the  structure  of  the  minimax  algebra,  and  thus  all  mathemati- 
cal results  of  the  minimax  algebra  are  applicable  to  solving  problems  in  image  processing. 

In  particular,  we  have  shown  that 

(1)  Many  notions  encountered  in  investigating  linear  transforms,  such  as  the 
eigenvalue/eigenvector  problem,  rank,  linear  independence,  and  solutions  to  systems  of 
equations,  have  their  counterpart  in  image  algebra.   The  use  of  these  notions  to  solving 
specific  image  processing  problems  remains  to  be  seen. 

(2)  The  image  algebra  is  useful  as  a  model  in  mapping  a  class  of  non-linear  transforms  to 
parallel  architectures.   It  is  feasible  to  map  any  arbitrary  lattice  transform  to  most 
parallel  architectures;  that  is,  given  a  network  of  processors  that  are  interconnected  by 
communication  links,  a  lattice  transform  has  a  weak  decomposition  into  a  product  of 
lattice  transforms  that  are  each  local  with  respect  to  the  network  in  and  only  if  every 
pair  of  processors  has  a  two-way  path  of  communication  between  them.   There  is  at 
most  one  weak  (pointwise)  operation  of  maximum,  with  the  remaining  operations  being 
convolutions.   The  pointwise  maximum  which  represents  the  fact  that  a  small  amount 
of  storage  is  needed  to  compute  the  transform  is  not  an  unreasonable  restriction. 
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(3)  Mathematical  morphology  is  a  special  subclass  of  the  lattice  transforms,  namely  the 
transforms  corresponding  to  invariant  templates  from  X  to  X  having  the  target  pixel 
as  part  of  their  support  at  each  pixel.   Thus,  the  lattice  subalgebra  of  the  image  alge- 
bra generalizes  mathematical  morphology.   The  image  algebra  is  a  clear  and  simple 
mathematical  representation  of  mor]3liological  concepts,  avoiding  the  cumbersome 
notion  of  umbra,  for  example. 

(4)  The  minimax  algebra  lends  itself  well  to  the  investigation  of  matrix  decomposition 
techniques.   A  weak  decomposition  was  shown  for  any  matrix  lattice  transform.   Thus, 
the  application  of  a  matrix  product  for  any  purpose  can  be  implemented  in  parallel. 
This  includes  problems  from  operations  research. 

(5)  Although  the  minimax  algebra  is  not  a  Euclidean  domain,  the  representation  of  a  type 
of  division  algorithm  was  found.   In  boolean  images,  there  are  clear  applications  of 
these  types  of  skeletonizing  technic(ues  to  image  compression. 

We  now  list  some  suggestions  for  further  research.  The  author  continues  to  pursue  this 
general  area  of  research,  and  would  appreciate  being  informed  of  any  results  obtained  related 
to  the  following  problems. 

Unlike  linear  algebra,  the  minimax  algebra  is  relatively  unknown.   The  matrix  proper- 
ties developed  so  far  in  the  literature  [38]  were  meant  primarily  for  use  in  operations  research 
problems.   A  wealth  of  mathematical  results,  with  possible  apj)lications  to  real  world  prob- 
lems, are  obviously  obtainable  from  investigaUng  otiier  uses  of  the  minimax  algebra.   The 
matrix  decomposition  techniques  presented  in  this  dissertation  are  a  clear  example.   Specific 
problems  are:  investigate  Chapter  3's  stat-eirients  for  applications  to  solving  image  processing 
problems.   What  specific  applications  docs  the  eigenproblem  have  in  image  processing?  The 
statements  in  Chapter  3  are  only  a  few  of  the  minimax  algebra  properties  that  were  mapped 
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to  image  algebra.   Investigate  other  properties  in  the  Minimax  Algebra  book  which  may  have 
uses  in  image  processing.   Is  there  a  niininia.\'  transform  equivalent  to  the  linear  Fourier 
transform?   What  are  its  uses?   What  other  types  of  linear  transforms  have  a  minimax 
equivalent?   Can  other  techniques  in  linear  algebra,  such  as  the  SVD,  Kronecker  products, 
etc.  be  described  in  a  similar  way  in  the  minimax  algebra?   Develop  techniques  for  decompo- 
sition of  square  matrices  that  are  block  toeplitz  with  toeplitz  blocks,  with  non-null  diagonal 
entries.   As  mentioned  in  Chapter  4,  this  tyi:)e  of  matrix  corresponds  to  the  concept  of  a 
structuring  element  in  mathematical  morphology,  and  to  a  class  of  invariant  templates  in  the 
image  algebra. 

Another  question  concerns  the  existence  theorem.  Theorem  5.24.   Does  there  exist  a 
local  decomposition  that  is  not  weak,  that  is,  a  decomposition  with  no  operation  of  V?  This 
would  relieve  the  storage  requirement  associated  with  V.   .A.lso,  is  there  a  similar  existence 
theorem  with  the  digraph  D(W)  replacing  the  graph  G(W)?   Although  the  existence  theorem 
given  in  Chapter  5  is  constructive,  one  would  rarely  implement  the  decomposition  in  this 
manner.   Describe  a  general  decomposition  technique  giving  local  templates  and  which  is 
minimal  with  respect  to  some  criterion,  such  as  the  number  of  factors  in  the  decomposition. 
Also,  what  type  of  applications  to  operations  research  does  the  decomposition  theorem  have? 

The  continuous  cases  for  the  image  algebra  operands  ©,  M  ,  and  ®  have  yet  to  be  well 
established.  Establish  the  mathematical  foundations  for  the  continuous  counterparts  involv- 
ing the  lattice  operation.s  El ,  ® ,  and  V. 

In  his  dissertation  Gader  asks  the  question  about  relating  circulant  templates  under  M 
or  ®  to  group  algebras.   Will  the  formal  minirnax  matrix  relationship  established  with  the 
image  algebra  make  the  pursuit  of  tliis  particular  question  any  easier? 
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Is  there  a  practical  use  for  the  division  algorithm?  Generalize  the  division  algorithm  to 
a  sequence  of  templates  t;  replacing  the  single  t. 
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